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DESCRIPTION 

RECORDING MEDIUM, REPRODUCTION DEVICE, PROGRAM 

Technical Field 
5 [0001]. 

The present invention relates to a technique of 
defining a playback path. 

Background Art 
10 [0002] 

A playback path is a logical unit of a digital stream 
recorded on a recording medium and defined by playback path 
information also recorded on the recording medium. A 
playback apparatus executes playback of the digital stream 

15 in accordance with the playback path information. With 
this technique, simply by defining a plurality of pieces 
of playback path information, the same digital stream can 
be played back with variations. With this advantage, the 
technique is considered essential in creating multi-story 

20 movies. 
[0003] 

Playback path information may be defined using 
addresses on the recording medium or time information. In 
- the case of playback, path inf ormatipn defined using time . 
25 information, the time information needs to be converted 
into address information of a specific point on the stream. 
The conversion is carried out by converting the time 
information specifying the start point of playback path 
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(In_time) to the address of an I picture . Here, the address 
derived from the same In_time differs depending on the GOP 
structure of the video stream. In the case where the video 
stream is an MPEG2-Video stream and the In_time corresponds 
to a Closed-GOP, the first I picture of the GOP shall be 
read. Thus, the address of the first I picture in the GOP 
to which In_time belongs needs to be derived as a result 
of the conversion. 
[0004] 

On the other hand, an Open-GOP has reference to the 
previous GOP and is not independently decodable. In order 
to correctly start playback from an.Open-GOP corresponding 
to In_time, the playback apparatus needs to start reading 
the. video stream from the immediately preceding GOP to the 
GOP corresponding to the In__time. As described above, 
playback of an Open-GOP requires the playback apparatus 
to read an extra GOP before reading the Open-GOP. 

The following patent literature discloses a data 
structure for facilitating playback of a playback path 
defined using time information. 

Patent Literature 1 : JP Patent Application Publication 
No. 2001-169247 (Application No. 2000-228656) 

Disclosure of the Invention 

Problems the Invention is attempting to Solve 
[0005] 

In the case of an MPEG2-Video stream, an open-GOP uses 
reference pictures as far as from the immediately previous 



GOP- In the case of an MPEG4-AVC stream, however, an 
open-GOP may have a reference to a picture contained in 
as many as tens of frames before the' current frame. It 
is because the MPEG4-AVC decoder model uses two types of 
5 reference pictures, namely short-term reference pictures 
and long-term reference pictures. A long-term reference 
picture may be used by a picture that is located tens of 
pictures after the long-term reference picture. Thus, 
reading of the immediately previous GOP is not sufficient 
10 to provide the decoder with all the reference pictures 
necessary for decoding. 
[0006] 

In view of the above, the playback apparatus needs 
to read a large number of pictures in preparation for the 

15 worst case. In the worst case, a picture to be decoded 
may have a reference to a picture located at the beginning 
of the video stream. If so, the playback apparatus needs 
to read all the pictures from the beginning of video stream. 
Suppose, for example, that a video stream is worth two hours 

20 of playback and that a request is made to start playback 
from a point corresponding to' one hour from. the beginning 
of the video stream. In this case, the playback apparatus 
is required to read and decode picture data worth one hour 
of playback time. Thus, it takes a long time before all 

25 the necessary reference pictures are ready in the decoder. 
[0007] 

As described above, it takes a relatively long time 
to specify the start address of a playback path defined 



using time information. Due to this drawback, theMPEG4-AVC 
standard is said not suitable for movie distribution via 
a recording medium. MPEG4-AVC streams are said most 
advantageous in the form of stream distribution where. the 
5 stream is always played back from the beginning. Yet, in 
view of the advantage of high image quality and high 
compression rate, it is a waste to abandon the application 
of MPEG4-AVC standard to recording media even if it takes 
a relatively long time to specify the start address of a 
10 playback path defined using time information. 
[0008] 

In view of the above, the present invention aims to 
provide a recording medium that ensures efficient playback 
of a video stream following a playback path defined, using 
15 time information, in the case where the video stream contains 
an open-GOP having a reference to a GOP located at quite 
a distance in the video stream. 

Means for Solving the Problems 

[0009] . . - - . ■ ' * ■ 

In an attempt to achieve the above aim, the present 
invention provides a recording medium having a video stream, 
playlist information, and an entry map recorded thereon. 
The playlist information defines a playback path by 
indicating a sequence of one or more pairs of a playback 
start time and a playback end time within the video stream. 
The entry map indicates a plurality of entry points in the 
video stream, in one-to-one correspondence with a plurality 
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of entry times and flags. Each flag indicates whether an 
intra picture at a corresponding entry point is for causing 
decoder refresh. 



5 Effects of the Invention 
[0010] 

According to the present invention, each flag recorded 
on the recording medium is associated with a picture located 
at an entry point and indicates whether the associated 

10 picture is an intra picture that causes decoder refresh 
or an intra picture that has a reference to a previous picture . 
With reference to the flags associated with the respective 
entry points, the playback apparatus is enabled to 
distinguish which of. the pictures are intra pictures for 

15 causing decoder refresh . Even in the case where an open-GOP 
has a reference to a number of pictures away, the long-term 
reference does not go beyond any picture at which the decoder 
is to be refreshed. Thus, when executing playback of a 
playback path defined using time information, the playback 

20 apparatus starts reading from the first previous picture 
for causing decode refresh. Consequently, it is ensured 
that the decoder is supplied with all the reference pictures 
necessary for decoding a picture located at the start point 
of the playback path. 

25 [0011] 

Suppose, for example, that a video stream is worth 
two hours of playback and that playback is to be. executed 
from a playback point corresponding to one hour of playback 



time from the stream start point. In order to execute such 
playback^ reading of the video stream should be started 
from the first previous picture for causing decoder refresh, 
so that all the necessary reference pictures are 
5 sufficiently supplied to the decoder. ' Consequently, data 
that needs to be read is reduced from data worth one hour 
to data worth fifteen minutes- A3 a result, reference 
pictures necessary for decoding the picture at the requested 
playback start point will be ready in the decoder sooner 
10 than in a conventional technique. With this improvement, 
the MPEG4-AVC format is applicable to a wider variety of 
uses, including movie distribution via recording media. 

Best Mode for Carrying. Out the Invention 

15 [0012] 

(FIRST EMBODIMENT) 

The following describes, an embodiment of a recording 
' medium according-to the present invention. First of all, 
among various acts of practicing a recording medium of the 

20 present invention, an act of using is described. Fig. 1 
illustrates a form of using the recording medium according 
to the present invention. . In Fig. 1, a BD-ROM 100 is a 
recording medium according to the present invention. The 
BD-ROM 100 is used to supply a movie to a home theater system 

25 composed of *a playback apparatus 200, a remote controller 
300, and a television set 400. 
[0013] 

This concludes the description of the act of using 
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the recording medium of the present invention. Now, the 
following describes the act of manufacturing, as one example 
of acts of practicing the recording medium of the present 
invention. Fig. 2 illustrates the internal structure of 
5 the BD-ROM. 

In the figure, the BD-~ROM is illustrated on the fourth 
level, and the track of the BD-ROM is illustrated on the 
third level . The track is laterally stretched out , although 
the track in practice spirals outwards from the center of 

10 the BD-ROM. The track is composed of a lead-in area, a 
volume area, and a lead-out area. The volume are*a has a 
layer .model of a physical layer, a file system layer, and 
an application layer. The first level illustrates, in a 
directory structure, a format of the application layer 

15 (application format) of the BD-ROM. As illustrated on the 
first level, the -BD-ROM has a ROOT directory, and the ROOT, 
directory has a . BDMV directory. 
[0014] 

The BDMV directory has three subdirectories called 
20 a PLAYLIST directory, a CLIPINF directory, and a STREAM 
directory. 

The STREAM directory stores files, with the extension 
^^.m2ts" (e.g. files called ^^00001 . m2ts'' , ^^00002 .m2ts'^ 
and ''00003 .m2ts" ) containing data constituting the main 
25 body of an individual digital stream. 
[0015] 

The PLAYLIST subdirectory stores files with the 
extension ''.mpls'' (e.g. files called ''00001 .mpls", 
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"'00002 .mpls", and "^OOOOSmpls") . 

The CLIPINF directory stores files with the extension 
"".clpi" (e.g. files called "'00001 .dpi", "'00002 . dpi", and 
"OOOOS.clpi") . 

5 

<AV Clip Structure> 

Next, a description is given of files with the extension 
".m2ts". Fig. 3 schematically illustrates the structure 
of a file' with the extension ".m2ts". Each file with the 
10 extension ''.m2ts" (namely, 00001. m2ts, 00002. m2ts, 
00003. m2ts, ...) contains an AV clip. The AV clip, 
(illustrated. on the middle level) is created as follows. 
A video stream (illustrated on the upper first level) 
containing a plurality of video frames (pictures pj 1 , pj2, 
15. ■_ pj.3, ...:) is conyierted into PES packets (illustrated on-the 
upper second level) . Similarly, an audio stream 
(illustrated on the upper first level), containing a 
plurality of audio frames is converted into PES packets 
(illustrated on the upper second level) . The resulting 
20 . PES packets are further converted into TS packets 
(illustrated on the upper third level) . In addition, the 
presentation graphics stream carrying text subtitle data 
(the PG stream illustrated on the lower first level) and" 
the interactive graphics stream carrying interactive 
25 composition data (the IG stream illustrated on the lower 
second level) are converted into TS packets. These TS 
packets of the video, audio, IG, and PG streams are 
multiplexed to form the AV clip. 



[0016] 

Next, a description is given of how an AV clip, which 
is an MPES2-TS digital stream, is recorded onto the BD-ROM. 
Fig. 4 illustrates the process through which TS packets 
5 carrying the AV clip are recorded onto the BD-ROM. In Fig. 
4, the TS packets of the AV clip are illustrated on the 
first level. 

As illustrated on the second level, each TS. packet 
of the AV clip is attached with ^^TS__extra_header" (denoted 
10 as ''EX'' in the figure) . 
[0017] 

The third and fourth levels illustrate the physical 
units of the BD-ROM in .relation to the TS packets. As. 
illustrated :on the fourtH level, the track on the BD-ROM 

15 is divided into a plurality of sectors. The TS packets 
each attached with the TS__extra__header (hereinafter, simply 
^'EX-TS packets'') are divided into groups of 32 EX-TS packets, 
and each group is written into three sectors of the BD-ROM. 
Each group composed of 32 EX-TS packets amounts to 6,144 

20 (= 32 X 192) bytes, which is -equal to the total size of 
three sectors (= 2048, x 3) . Each group of 32 EX-TS packets 
stored in three sectors of the BD-ROM is referred to as 
an '^Aligned Unit". When data is recorded onto the BD-ROM, 
encryption is carried out in Aligned Units. 

25 [0018] 

As illustrated on the fifth level, an error correction 
code is attached to every 32 sectors to constitute an ECC 
block. As long as accessing the BD-ROM in Aligned Units, 



the playback apparatus is ensured to obtain a complete set 
of 32 EX-TS packets. This concludes the description of 
the process of recording the AV clip onto the BD-ROM. 

5 <Video Stream> 

The following describes the internal structure of an 
MPEG4-AVC video stream. An MPEG4-AVC video stream is 
composed of a plurality of pictures. Fig. 5A illustrates 
the plurality of pictures arranged in the coding order. 
10 [0019] 

In the figure, the reference numerals ^^I", ^'P'', and 
''^B" denote, an I picture,, a P .picture, and a B picture, 

^ respectively. ^ There are two. types' of I pictures: one is 
an IDR picture and the other is a Non-IDR I picture . Non-IDR 

15 I pictures, P pictures, and B pictures are encoded using 
correlation with other pictures. -More specifically, a B 
picture is composed of Bidirectioanlly Predictive (B) 
slices, and a P picture is composed of Predictive (P) slices.. 
There are two types of B pictures: one is a reference. B 

20 picture, and the other is a non-reference B picture. 
[0020] 

In Fig. 5A, a Non-IDR I. picture is denoted as ^^I", 
and an IDRpicture is denoted as ^'IDR'' . The same denotations 
are used throughout the following descriptions and figures . 

25 

<GOP Structure>- 

Fig. 5B illustrates the GOP structure of the video 
stream illustrated in Fig . 5A. As illustrated in the figure, 

r 
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an IDR picture, together with the following B and P pictures, 
forms a closed-GOP. On the other hand, a Non-IDR I picture, 
together with the following B and P pictures, forms an 
open-GOP. 
5 [0021] 

Fig. 6A illustrates the internal structure of a 
closed-GOP. The upper level illustrates the pictures of 
the closed-GOP in the presentation order, and the lower 
level illustrates the pictures of the closed-GOP in the 
10 coding order. In the coding order, the closed-GOP starts 
• with an IDR picture. In the presentation order, however, 
. the. IDR picture is not the first picture in^the closed-GOP. 
Yet, even the pictures other than the IDR picture (B and 
' P pictures) do not rely on any pictures from the previous 
15 GOPs . In the f igure, an arrow attached with the mark ^^x'' 
represents that the closed-GOP does not use any reference 
pictures from the previous GOPs. As described above, a 
closed-GOP is independent without any reference to the 
previous GOPs. 
20 [0022] 

Fig. 6B illustrates the internal structure of an 
open-GOP. The upper level of Fig. 68 illustrates the 
pictures of. the open-GOP in the presentation order, and 
the lower level illustrates the pictures of the open-GOP 
25 in the coding order. In the coding order, the open-GOP 
starts with a Non-IDR I picture . In the presentation order, 
however, the IDR, Non-IDR I, and P pictures are arranged 
in a different sequence. More specifically, in the 
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presentation order, B pictures precede the Non-IDR I picture . 
The B pictures preceding the Non-IDR I picture relay on 
the previous GOPs . Yet, pictures subsequent to the Non-IDR 
I picture do no rely on any pictures from the previous GOPs. 
5 As described above, an open-GOP may have references to the 
previous GOPs. This concludes the description of the GOP 
structure of an MPEG4-AVC stream. 
[0023] 

' Next, the following describes the internal structures 
10 of an IDR , picture , and a Non-IDR I. picture. Fig. 7A 
- illustrates the internal structure, of an IDR picture. . As 
illustrated in the figure, the IDR picture is composed of 
a plurality of Intra slices. Fig. 7B illustrates the 
internal structure of a Non-IDR I. picture. Different from 
15 the IDR picture composed solely of Intra slices, the Non-IDR 
I picture is composed of Intra-, P-, and B-slices.' Fig. 
7C illustrates the dependencies between the Non-IDR I 
picture and other pictures. A Non-IDR I picture may be 
composed of B and P slices and thus may have references 
20 to other pictures. 
• [0024] 

Fig. 8 illustrates the dependencies that a Non-IDR 
I picture may have . The first level illustrates a sequence 
of pictures in the presentation order. The second level 
25 illustrates a sequence of pictures in the coding order. 
Arrows in the figure schematically represent references 
that the Non-IDR I picture may have . Although some pictures 
are referenced over a relatively long period, no picture 
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is referenced beyond an IDR picture. It is because an IDR 
picture requires decoder refresh, so that all the reference 
pictures stored on the decoder are erased. Thus, no Non-IDR 
I picture has references beyond an IDR picture. 

5 

<IDR picture> 

The following describes the technical significance 
of inserting IDR pictures in a video stream. An IDR picture 
forms a closed-GOP arid is not located at fixed-unit intervals, 
. lO ' v such'as. every GOP . . The number and locations. of IDR pictures • 
contained in a single video. stream vary depending oh the 
encoding condition . Depending on the encoding condition, 
a video stream may contain- relatively few IDR pictures or 
relatively many IDR pictures. Since an IDR picture is 

15 encoded without using any short-term and long-term 
reference pictures, the video stream containing a larger 
number of IDR pictures achieves lower compression rate. 
Thus, the compression rate decreases with the increase in' 
the number of IDR pictures. Yet, the presence of at least 

20 one IDR picture in the video stream significantly helps 
to efficiently execute trick play starting from a randomly 
chosen point in the video stream. 
[0025] 

Suppose, for example, a P picture needs to be decoded 
25 to execute trickplay. In this case, it cannot be determined 
up to how many previous pictures in the video stream need 
to be decoded in order to decode the P picture . It is because 
the target P picture may have references to a previous B 



1 



picture, and the B picture may in turn have references to 
another previous B or P picture in the. boding order. Thus, 
there is no fixed rule as to how may previous pictures need 
to be'decoded for correctly decoding the target P picture.. 
5 Yet, if the video stream contains IDR pictures at appropriate 
points, it is known that inter-picture dependencies do not 
exist across any IDR picture. Thus, decoding of up to the 
-nearest preceding IDR picture ensures that all the-.pictures 
; .necessary for playback of the: tar-get P picture is supplied' 
10 , to the decoder. In this .way, decoding of a P picture in 
trick play execution is facilitated. As a consequence, 
fast-speed playback of the video stream, which involves 
sequential decodingof I and Ppictures, is'readily executed. 
[0026] 

15 As described above, the number and locations of IDR 

pictures in a single video stream « are determined in 
accordance with the encoding condition. In the 
determination, it is important to consider both the 
efficiency of trick play and compression rate. The 

20 description of the present embodiment is given on 
precondition that IDRpictures are located at relatively 
long time intervals, such as fifteen-minute or thirty- 
minute intervals - 

25 <Recording to BD-ROM> 

Next, the following describes how IDR pictures and 
Non-IDR I pictures are converted into TS packets and recorded 
onto the BD-ROM. Fig. 9 illustrates the process through 

14 



which an TDR or Non-1 DR I picture "is converted into TS packets . 
In the figure, the first level illustrates an IDR or Non-IDR 
I picture. The second level -illustrates an Access Unit 
stipulated according. to MPEG4-AVC. A plurality of slices 
constituting the IDR or Non-IDR I picture is arranged in 
a , sequence. Then/ AUD (Access Unit Delimiter), SPS 
.( Sequence. Parameter Set ) , PPS ( Picture Parameter. Set ) , and 
■ SET .( Supplemental Enhanced; Inf ofmat-ioh) are- .attached to 
the. slice sequence . In this way, " the picture slices are', 
converted into an Access Unit. 
[0027] 

AUD, SPS, PPS, SEI, and Access Unit mentioned above 
are information all stipulated according to MPEG4-AVC and 
described ' in various documents, such as ^'ITU-T 
Recommendation H.264"'. For the details, such documents 
should be referenced. The point in this description is 
that AUD, SPS, PPS, and SEI need to be supplied to the playback 
apparatus for executing random access to the video stream. 

The third level illustrates NAL units . AUD, SPS, PPS, 
SEI, and slices illustrated on the second level are 
separately attached with a header to be converted into 
separate NAL units • NAL units are supported by the Network 
Abstraction Layer (NAL) stipulated according to MPEG-4 AVC 
and described in various documents, such as ^'ITU-T 
Recommendation H.264". For the details, such documents 
should be referenced. The point, in this description is 
that AUD, SPS,. PPS, SEI, and each slice are converted into 
separate NAL units and manipulated independently in the 
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Network -Abstraction Layer. 
[0028] 

As described- above ^ the single picture is converted 
■ into a plurality of NAL units. • Then, the NAL units are 
5 converted into PES packets illustrated on the fourth level, 
and the PES packets are converted into TS packets . Finally, 
"the resulting TS,pa.ckets 'are .recorded onto -the. ;BD-ROM;. 
' ,In order to play back one GOP, the playback apparatus 

. needs to supply the decoder with a NAL unit containing AUD 
IQ- of. the first IDR or Non-IDR I picture in the GOP. That 
is, the NAL unit containing AUD is us-ed as an. index for 
. decoding the IDR or Non-IDR I picture . In this embodiment, 
each NAL unit containing AUD is regarded as a point. For 
playback of the video stream, the playback apparatus 
15 recognizes each. of such a point as an entry point for 
executing playback of an I picture. Consequently, for 
execution of jump playback to a randomly access point in 
the AV clip, it is extremely important for the playback 
apparatus to recognize the locations of AUDs of IDR and 
20 Non-IDR I pictures. This concludes the description of the 
structure of the MPEG-4AVC video stream. 

<Clip inf ormation> 

Next, the following describes files with the extension 
25 "".dpi". Each file with the extension ^^.clpi" (e.g. 
00001. dpi, 00002. dpi, 00003 . dpi , ...) contains Clip 
information. Each piece of Clip information is management 
information of an individual AV clip. Fig. 10 illustrates 
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the internal structure of a piece of Clip, information • As 
illustrated in the left block of the /figure, the Clip 
information is composed of the following fields: 

( i ) ^'Cliplnf o ( ) " storing the attributes of the AV clip, 
•file; . " ■ ■ ■ ■ ^ . ' • 

, , ■ ;(ii) /'Sequence Inf o ( ) storing inf ormaiion. related.- 
.to-' the- ATC sequence and ^.^^^ sequence; 

' (iii) ^'Program Inf o ( ) storing' information related 
to the program sequence; and 

(iv) ^'Characteristics Point Info (CPI ())".' 

Leader lines cul in the figure indicates that the 
structure of the i-th program sequence (Program 
Sequence(i)) is illustrated in greater detail. As 
indicated by the leader lines . cul, the Program Info 
associated with the Program Sequence (i). is composed of the 
total number of Ns(i) pairs of Stream_PID and 
Stream_Coding_Inf o (in the figure, Stream_PID [i] (0) and 
Stream_Coding_Inf o (i, 0) -Stream_PID [i] (Ns (i) - 1) and 
Stream_Coding_Inf o (i, Ns (i) -1 ) ) . 
[0029] 

The Stream_PID is a packet identifier of an individual 
packet carrying an elementary stream constituting the AV 
clip. The Stream_Coding_Inf o indicates the coding 
standard used to encode the elementary stream. 

Fig. IIA illustrates the Stream_Coding_Inf o 
associated with the video stream, whereas Fig. IIB 
illustrates Stream_Coding_Inf o associated with the audio 
stream. The Stream_Coding__Inf o . is composed of the 
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following fields: ^'stream_coding_type'' indicating the 
coding method of the video stream is either MPEG4-AVC or 
MPEG2-Video; • ^'video_f orm^t"- indicating the video format 
is 4.80i,. 57'6i., .4 8Dp., -" IQSOi , . ;720p, or ioSOp)-; . ^>f ranie_rate/'. 
■indicating the fx'ame rat stream "is 23> 976Hz,- 

29.97Hz, or 59.94Hz; arid ''aspect_ratio": indicating the 
aspect" ratio of the pictures is 4:3 or 16:9. 
[0030] 

Fig. IIB illustrates the Stream_Coding_Inf o 
associated with the audio stream. As illustrated in the 
figure, the Stream_Coding_Inf o associated with the audio 
stream is composed of the following fields: 
. ^^stream_coding_type" indicating the coding type of the 
audio stream is LPCM, Dolby-AC3, or Dts; 
''audio_presentati"on_type" indicating the presentation 
type of the audio stream is stereo channel, mono channel, 
or multi-channel; ^^sampling_f requency'' indicating the 
sampling frequency of the audio stream; and 
^'audio_language" indicating a language code of the audio 
stream. 
[0031] 

With reference to the Stream_Coding_Inf o, the playback 
apparatus is enabled to identify which of the elementary 
streams contained in an AV clip are MPEG4-AVC streams. 

<CPI (EP__map) > 

Next, a description of CPI is given with reference 
to Fig. 10 again. Leader lines cu2 in the figure indicates 

18 



that the structure of CPI is illustrated in greater detail. 
As illustrated in the.leader. lines cu2, the CPI is composed 
.of a plurality. of EP^iyiap -fields Each EP_map is ^ composed 
■:0 f " y'Ne ■ p i e ce s ;•- . o f 'E P_map^f or-Jonei^'S t r e am vP I D . \ ( name ly , ' 
EP_map_f or_one_stream_PID.( 0.) --(Ne-r) ) . ■ Each piece of.. 
EP_map_f or_one_stream_PID is an EP_map associated with one 
of elementary streams contained in the AV clip. An EP_map 
is information indicating entry points set on the associated 
elementary stream. An entry point is where the Access Unit 
Delimiter of an I picture is present. The EP_map indicates 
the packet number of each entry point (SPN_EP_start ) and 
the corresponding entry time ( PTS_EP_start ) . Leader lines. 
cu3 in the figure indicates that the Internal structure 
of EP_map_f or__one_stream_PID is illustrated in greater 
detail. 
[0032] 

As illustrated in the figure, the 

EP_map_f or_one_stream_PID is composed of Nc pieces of 
EP_High (EP_High ( 0 ) - (Nc-1 ) ) and Nf pieces 'of EP_Low 
(EP_Low(0) - (Nf-l) ) . Here, the EP_High holds the most 
significant bits of the SPN_EP_start and PTS__EP_start of 
an I picture. The EP_Low holds the least significant bits 
of the SPN_EP_start and PTS_EP_start of the • I picture. 

Leader lines cu4 in the figure indicate that the 
internal structure of the EP__High is illustrated in greater 
detail . As illustrated in the leader lines cu4, EP_High (i ) 
is composed of the following fields: ''ref_to_EP_Low_id[i] " 
which is a reference value to the EP_Low ; "'PTS_EP_High [ i ] " 
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indicatihg the most signif icp-ant bits, of the PTS for the 
I. picture; \ and . . ^'SPN_EP__High-[ i.] " indicating the . most 
vsi'gni-fica:-B^^^ the'SPN for the. I picture. Hefe> -the* 

fefererice numeral ^^i'' denotes • an identifier -uniquely 
identifying an arbitrary EP_High field. * • ' . 
[0033] ■ . . • ' .■ . 

Leader lines cu5 in the figure indicate that the EP__Low 
structure is illustrated in greater detail. As indicated 
by the leader lines cu5, the EP_Low is composed of the 
following fields: is_angle__change_point (EP__Low_id) 
^^I_end_position_of f set (EP_Low_id) " indicating the size 
of the associated I picture; ''PTS_EP_Low (EP_Low_id) " 
indicating the least significant bits of the PTS of the 
associated I picture; and "'SPN_EP_Low (EP_Low_id) " 
indicating the least significant bits of the SPN of the 
associated I picture. Here, the ^^EP_Low_id" denotes an 
identifier uniquely identifying an arbitrary EP_Low field. 
[0034] 

The data structur.e of the EP_map as described above 
is basically disclosed, for example, in the above patent 
literature. Thus, no further description is given in this 
specification- Yet, the flag called 

is_angle_change_point" is one feature of the present 
invention and thus will be described in detail. 

The is_angle_change_^poinf is a flag indicating 
whether the I picture specified as an entry point serves 
as a point where the playback apparatus can enter to the 
AV clip f ormother AV clips • Fig. 12 illustrates the concept 
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. of entering to an AV ..clip and. exiting form the AV. . Here, 

/ L . the process... of entering -t'o.. an; Ay ' clip refers tp th^ -seek 
• p^^^ of causingthe optical pickup tom^ current 

, TS packet contained in the current AV clip to a TS packet 
5 contained in another AV^clip. An arrow erl illustrated 
in Fig.- 12 schematically represents the movement of the 
optical pickup at the time of entering to the AV clip. Each 
TS packet specified by the ±s_angle_changel_point field set 
to the value ^''1" is judged as a permissible entering point. 

10 [0035] • ' 

The TS packet immediately preceding a TS packet 
.specified by the is_angle_change_po.int field set to the 
value ^^1'' is judged as an exit point to the AV clip. Here, 
the process of exiting from an AV clip refers to a seek 

15 process of causing the optical pickup to move from the 
currently reading TS packets contained in the current AV 
clip to a TS packet contained in another AV clip.. An arrow 
exl illustrated in Fig. 12 schematically represents the 
movement of the optical pickup exiting from the AV clip. 

20 [0036] 

At the time of entering to an AV clip from another 
AV clip, the decoder cannot use any pictures obtained through 
the decoding process having been conducted by that time. 
Thus, the I picture specified as an entry point by the 
25 is_angle_change_point field set to the value ^^1" must be 
an IDR picture. That is, the is_angle_change_point'' set 
to the value ^^1" indicates that the specified I picture 
is an IDR picture. The is_angle_change_po.int'' set to the 
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.value ^^-0" indicates that the specified I picture is aNon-IDR- 
I pict.ure . The process illustrated • in- the f igure/ i . e . . 
the process of ^^exiting" from the currently played AV clip 
and ^^entry" to another AV clip .is referred . to as . 
'Vangle_change''>,.' The field is named 

is_angle_change_poi.nt'' in view of that the field specifies 
a point where ^'angle_change" is possible. It should be 
noted, however, that provision of the EP__map having the 
is_angle_change__point field set to ''^1" is not sufficient 
to implement the angle change process. The implementation 
of the angle change . process additionally requires 
improvements on AV clips and PlayList information. The 
improvements of AV clips and PlayList information necessary 
for implementing the angle change, will be described later 
in detail in a second embodiment of the present invention. 
Thus, such description is omitted in this embodiment. 
[0037] 

It should be noted, in addition, that the EP_map is 
expressed as a pair of EP_High and EP_Low values in terms 
of the data structure. Yet, for the sake of simplicity 
of the description, unless specifically noted, the most 
significant bits and least significant bits of the PTS 
indicated by EP_High and EP_Low are "collectively denoted 
as PTS__EP_start . Similarly, the most significant bits and 
least significant bits of the SPN indicated by EP_High and 
EP_Low are collectively denuded as SPN__EP_start . 

The following describes how the EP_map associated with 
the video stream illustrated in Figs. 5 and 8 is set. Fig. 
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■ 13 illustrates the setting of the EP_map associated with 
' the video stream illustrated in Fig. 5. The first level 
illustrates a -sequence of a plurality of. pictures arranged 
.in the presentation order. The second iev^l illustrates 
..5 the timeline for. the picture sequence. The fourth level 
illustrates a plurality of TS packets stored on the BD-ROM, 
The third level illustrates the EP_map setting. Suppose 
that I pictures are located at points tl, t2, t3, t4, and 
t5 on the^ timeline illustrated oh the second level. The 

10 PTS_EP_start fields of the EP_map are set to the value 
specifying the points tl-t5. The Access Unit Delimiters 
of the video stream stored on the.BD-ROM are located at 
points nl, n2, n3, n4, and n5 in the TS packet sequence. 
The SPN_EP_start fields of the EP_map are set to the value 

15 specifying points nl-n5. Among entry points #l-#5 
corresponding to the points tl-t5 and thus to the points 
nl-n5, pictures located at entry. points #1 and #3 are IDR 
pictures. Thus, for entry points #1 and #3, the 
is_angle_change_point is set to the value ^'1". Regarding 

20 the other entry points, namely entry points #2, #4, and 
#5, the is_angle_change_point is set to the value ^^0". 
[0038] 

Fig. 14 shows, in tabular form, pairs of EP__Low and 
EP_High values indicating the PTS__EP_start and the 
25 SPN_EP_start of entry points #l-#5 illustrated in Fig. 13. 
In Fig. 14, the left table shows the values of EP_Low and 
the right table shows the values of EP_High. 

In Fig. 14, the left table shows EP_Low { 0 ) - (Nf - 1). 
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The :EP_Low,(i) fi. t 1 r ^ of .the' P-TS_EP_Low indicate 

the least significant bits of the points tl-t5, respectively. 
The EP_Low(i)- (i + 1) values of the SPN_EP_Low indicate 
the least significant bits of the points nl-n5, respectively . 
5 Among the is_anglG_change_point { i) - { i + 1), each of the 
is_angle_change_point (i) and the is__angle_change_point [i 
+ 2) is set to the value ^^1'' because the corresponding I 
picture is an IDR picture. On the other hand^ each of the 
is_angle_change_po±nt{i + 1), (1 + 3), and (1+4) is set 
10 to the value ^"0" because their corresponding pictures are 
Non-IDR I pictures. 
[0039] 

The right table in Fig. 14 shows the values of 
EP_High (0) - (Nc - 1) set in the EP_map. Provided that the 

15 points tl-t5 commonly have the same set of most significant 
bits and the points nl-n5 commonly have the same set of 
most significant bits, the values of PTS_EP_High .and 
SPN_EP_High are set to the respective sets of most 
significant bits. In addition, the ref_to_EP_Low__id is 

20 set to specify the first EP_Low. field (EP_Low(i)) out of 
the EP_Low fields indicating the points tl-t5 and nl-h5. 
With this setting, the EP_High indicates the common most 
significant bits of the PTS_EP_start and the common most 
significant bits of the SPN_EP_start . 

25 [0040] 

The most significant feature of such EP_map lies in 
that the data required to be read to execute jump playback 
is kept to a minimum. Fig. 15 illustrates the range of 
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data. required to be read to execute jump playback. 

Suppose, for example, jump playback is to be executed 
so as to start playback from the point corresponding to 
In_time illustrated in - the figure. When the point 
5 ■ corresponding to the In_time is a jump playback point, the 
- playback apparatus locates the nearest one of the entry 
point preceding the jump playback point and with the 
is_angle_change_point set to the value ^"1". In the figure, 
the entry point corresponding to the temporal point t3 has 

10 the is_angle_change_point set to the value ^'1". Thus, the 
playback apparatus retrieves the value of the SPN_EP_start 
= n3 of entry point #3 that corresponds to the PTS_EP_start 
= t3. The playback apparatus then reads the TS packets 
carrying the AV clip, starting from the point n3 and supplies 

15' the read TS packets to the decoder. With this arrangement, 
the playback apparatus is enabled to supply to the decoder 
all the reference pictures necessary for decoding the I 
picture. That is, the need is . eliminated to read the TS 
packets all the way from the beginning of the video stream. 

20 [0041] ' 

Suppose, for example, that- the video stream is worth 
two hours of playback time and that playback is to be started 
from a playback point whose In_time corresponds to one hour 
from the start of the video stream. In this example, the 
25 temporal point t3 corresponds to fifteen minutes before 
the In_time. Thus, by reading the preceding pictures up 
to the temporal point t3, the playback apparatus is enabled 
to supply all the reference pictures necessary for executing 



the- jump playback to the decoder. 

That is, when executing j ump playback to start playback 
from the point corresponding to the In_time which is ^^one 
hour after" the start of the video stream, the playback 
5 apparatus starts reading the pictures at most from the point 
corresponding to fifteen minutes before the temporal point 
t3. As a result, all the reference pictures necessary for 
the decoding process are duly supplied to the decoder. In 
this manner, playback of an MPEG4-AVC video stream stored 

10 on a BD-ROM can be started from any given point on the video 
stream by reading a minimum range of the stream data. This 
advantageous feature helps to use the MPEG4-AVC format for 
movie distribution via BD-ROM and thus significantly 
increases the usage of the MPEG4-AVC format. 

15 [0042] 

In the following description, a comparison is made 
in data structure between the EP__map f or an MPEG4-AVC stream 
and the EP__map for an MPEG2-Video stream. Both the EP_map 
for an MPEG4-AVC stream and the EP_map for an MPEG2-Video 

20 stream commonly show the relationships between the SPN and 
PTS values of I pictures. The difference lies in that the 
EP_map for an MPEG4-AVC stream includes the 
is_angle_^change_point field indicating whether the 
associated I picture is an IDR picture or a Non-IDR I picture . 

25 The EP_map of an MPEG4-AVC stream indicates, for each of 
IDR and Non-IDR I pictures, the is_angle_change_^point field 
in addition to a pair of SPN and PTS. Furthermore, the 
EP_map for an MPEG4-AVC stream is compatible with the EP_map 



for an MPEG2-Video stream. Owing to the compatibility 
between the EP_map for an MPEG4-AVC stream and the EP_map 
for an MPEG2-Video stream, BD-ROM creators are allowed to 
choose either of the MPEG2-Video and PEG4-AVC standards 
5 without giving any consideration to the EP_map structure. 
Consequently, a choice between the MPEG2-Video and 
MPEG4-AVC standards can be made relatively freely without 
being bound to EP_map structure . That is to say, the BD-ROM 
creators are offered wider variety of options in the 
10 . selection of codec standard. 
[0043] 

This concludes the description of the Clip information 
according to the present embodiment. Next, a description 
is given of files with the extension ^^mpls". 

15 . ^ 

<PlayList Information> 

Each file with the extension ^'mpls" (00001. mpls, 
00002. mpls, 00003. mpls ...) stores PlayList information. 
PlayList information defines a playback path called a 

20 PlayList that uses elementary streams . Fig. 16 illustrates 
the data structure of PlayList information. As illustrated, 
in the middle block of the figure, the PlayList information 
is composed of a plurality of pieces of PI ay I tern information . 
A Playltem defines a playback section by specifying a pair 

25 of In_time and Out_time on at least one AV clip timeline. 
With a plurality of pieces of Playltem information, the 
PlayList information defines a PlayList (PL) composed of 
multiple playback paths . The dashed lines hsl in the figure 



indicates that the internal structure of the Playltem 
information is illustrated in greater detail. As 
illustrated in the figure, • the Playltem information is 
composed' of- the following fields: 

5 ^'Clip___inf ormation_f ile_name'' indicating the name of a file 
containing the associated Clip information; 
''Clip_codec_identif ier" indicating the coding type of the 
associated AV clip; and ^^In_time"; and ^^Out__time. Fig. 
17 illustrates the relationship between the AV clip and 

10 the PlayList information. The. first level illustrates the 
timeline of the AV clip. The second level illustrates the 
timeline of the PlayList information (hereinafter, PL 
timeline) . The PlayList information contains three 
pieces of Playltem information called Playltem #1, #2, and 

15 #3. The In_time and Out_time of the respective pieces of 
Playltem information define three playback sections. By 
linearly aligning the three playback sections, a timeline 
that is different from the AV clip timeline is defined. 
This timeline is the PL timeline illustrated on the second 

20 level. As described herein, with the use of Playltem 
information, a different timeline from the AV clip timeline 
is defined. 
[0044] 

As described above, the EP_map contained in the Clip 
25 information indicates, for- each I picture contained in the 
video stream, a pair of SPN and PTS values of the I picture 
along with whether the I picture is an IDR picture. Since 
the EP_map enables the playback apparatus to efficiently 



execute trick play starting from a given temporal point, 
the PlayList information is expressed using time 
infotmation on precondition that trick play can be 
efficiently executed. This expression ensures the 
5 compatibility in data structure between the PlayList 
information on the BD-ROM and the PlayList information on 
a rewritable recording medium (BD-RE).. 
[0045] 

This concludes 'the description of the internal 
10 structure of the PlayList information according to the 
present embodiment and thus concludes the description of 
the recording medium according to the present invention. 
Next, a description is given of the playback apparatus 
according to the present invention. 

15 

<Interhal Structure of Playback Apparatus> 

Fig. 18 illustrates the internal structure of the 
playback apparatus. Based- on the internal structure 
illustrated in the figure, playback apparatuses consistent 

20 with the present invention are industrially manufactured. 
The playback apparatus of the present invention is roughly 
composed of two parts, one of which is a system LSI and 
the other is a drive device. By mounting those parts into 
a device cabinet and onto a substrate, the playback apparatus 

25 can be manufactured industrially. The system LSI is an 
integrated circuit containing various processing units for 
implementing the functions of the playback apparatus. The 
playback apparatus manufactured in the above manner is 
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composed of a BD drive 1, an arrival time clock counter 
2, a source de-packetizer 3^ a PID filter 4, a transport 
buffer 5, a multiplexed buffer Sr a coded picture buffer 
1 , a video decoder 8, a decoded picture buffer 10, a video 
plane 11, a transport buffer 12, a coded data buffer 13, 
a stream graphics processor 14, an object buffer 15, a 
composition buffer 16, a composition controller 17, a 
presentation graphics plane 18, a GLUT unit 19, a transport 
buffer 20, a codeddatabuf f er 21, a streamgraphics processor 
22, an object buffer 23, a composition buffer 24, a 
composition controller 25, an interactive graphics plane 
26, a GLUT unit 27, compositors 28 and 29, a switch 30, 
a network device 31, a local storage 32, an arrival time 
clock counter 33, a source de-packetizer 34, a PID filter 
35, a switch 36, a transport buffer 37, an elementary buffer 
38, an audio decoder 39, a transport buffer 40, a buffer 
41, a text subtitle decoder 42, a scenario memory 43, a 
controller 44, arid a PSR set 46. Note" that the internal 
structure illustrated in the figure is a decoder model based 
on the MPEG T-STD model and capable of downconverting . 
[0046] 

The BD drive 1 loads/ejects the BD-ROM and accesses 
the BD-ROM to sequentially read Aligned Units each composed 
of 32 ES-TS packets. 

The arrival time clock counter 2 generates an arrival 
time clock using a 27 MHz crystal oscillator (27 MHz X-tal) . 
The arrival time clock is a clock signal defining the timeline 
on which the ATS assigned to each TS packet is based. 
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[0047] • - 

Once an Aligned Unit composed of 32 EX-TS packets is 
read from the BD-ROM/ the source de-packetizer 3 removes 
the TP_extra_header from each ES-TS packet carrying the 
5 Aligned Unit and outputs the resulting TS packets to the 
PID filter 4. The output by the source de-packetizer 3 
to the PID filter 4 is performed at the timing when the 
time measured by the arrival time clock counter 2 reaches 
the ATS shown by the TP_extra__header . Since the output 

10 to the PID filter 4 is carried out in accordance with the 
ATSs, the TS packets are sequentially output to the PID 
filter 4 in accordance with the current time measured by 
the arrival time clock counter 2, irrespective of the speed 
at which data is read from the BD-ROM, such as Ix-speed 

15 or 2x-speed. 
[0048] 

The PID filter 4 judges^ with reference to the PID 
attached to the TS packets, the type of stream to which 
the TS packets belong is a video stream, a PG stream, or 

20 an IG stream. According to the judgment, the PID filter 
4 outputs the TS packets. to one of the transport buffers 
5, 12, 20, and 37. 

The transport buffer (TB) 5 is a buffer for temporarily 
storing TS packets output from the PID filter 4, if the 

25 TS packets belong to a video stream. 
[0049] 

The multiplexed buffer (MB) 6 is a buffer for 
temporarily storing PES packets output from the transport 



.buffer 5v in order to later output- the video stream to the 
coded picture buffer 7. 

The coded picture buff er (CPB) 7 is a buff er for storing 
coded pictures (I pictures^ B pictures, and P pictures) . 
5 [0050] 

The video decoder 8 decodes individual frames contained 
in the video elementary . stream at every predetermined 
decoding time (DTS) to obtain a plurality of frames and- 
writes the resulting picture data on the decoded picture 
10 buffer 10. 

The decoded picture buffer 10 is a buffer. on which 
decoded picture data is written. 

The video plane 11 is used for. storing uncompressed 
picture data. A plane is a memory area of the playback 
15 apparatus for storing a frame of pixel. value data. The 
. video plane 11 stores picture data at the resolution of 
1920 X 1080, and the picture data is composed of pixel values 
each expressed by 16-bit YUV values. 
[0051] 

20 The transport buff er (TB) 12 is a buff er for temporarily 

storing TS paclcets output from the FID filter 4, if the 
TS packets belong to a PG stream. 

The coded data buffer (CDB) 13 temporarily stores PES 
packets constituting a PG stream. 

25 The stream graphics processor (SPG) 14 decodes PES 

packets carrying graphics data (ODSs) to obtain 
uncompressed bitmap data expressed by index colors, and 
writes the obtained graphics data as a graphics object on 



the object buffer 15. 
[0052] 

The object buffer 15 holds the graphics object obtained 
as a result of the decoding by the stream graphics processor 
5 14. ' ■ 

The composition buffer 16 is memory for storing control 
information .(PCS) used for graphics data rendering. 

The composition controller 17 analyzes' the PCS stored 
on the. composition buffer 16 and executes control according 
10 to the analytical result. 
[0053] 

The presentation graphic plane 18 is a memory area 
as large as one full screen and stores uncompressed graphics 
data worth one screen. The presentation graphic plane 18 

15 stores uncompressed graphics data at the resolution of 1920 
X 1080 and the uncompressed graphics data is composed of 
pixel values each expressed using 8-bit index colors. By 
converting the index colors with reference to a CLUT (Color 
Lookup Table), the uncompressed graphics data stored on 

20 the presentation graphics plane 18 is supplied for display. 
[0054] 

The CLUT unit 19 converts the index colors of the 
uncompressed graphics data stored on the presentation 
graphic plane 18 to Y, CR, and Cb -values. 
25 The transport buff er (TB) 20 is a buff er for temporarily 

storing TS packets belonging to an IG stream. 

The coded data buffer (CDB) 21 is a buffer for 
temporarily storing PES packets constituting an IG stream. 



[0055] " • 

The stream graphics processor (SPG) 22 decodes PES 
packets containing graphics data and writes uncompressed 
graphics data obtained by the decoding to the object buffer 
5 23. 

The object buffer 23 stores a plurality of uncompressed 
graphics objects decoded by the stream graphics processor 
22. 

[0056] 

10 The composition buffer 24 is a buffer for storing 

control information used for graphics data rendering. 

The composition Controller 25 analyzes the control 
information stored on the composition buffer 24 and executes 
control according to the analytical result. 

15 The interactive graphics plane 26 is a plane on which 

uncompressed graphics data obtained as a result of .the 
decoding by the streamgraphics processor (SGP) 22 is written 
at the resolution of 1920 x 1080. The graphics data is 
composed of pixel values each expressed using 8~bit index 

20 colors. By converting the index colors with reference to 
the GLUT (Color Lookup Table), the uncompressed graphics 
data stored on the interactive graphics plane 26 is supplied 
for presentation. 
[0057] 

25 The GLUT unit 27 converts the index colors of the 

uncompressed graphics data stored on the interactive 
graphics plane 26 to Y, GR, and Gb values. 

The compositor 28 overlays the uncompressed frame data 
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stored on the video plane 11 with the uncompressed graphics 
object stored on the presentation graphic plane 18. As 
a result of the overlaying, the intermediate composite image 
in which text subtitles are overlaid on video is obtained. 

[0058] 

The compositor 2 9 overlays the uncompressed graphics 
object stored on the interactive graphics plane .26 with 
the intermediate composite image (uncompressedpicture data 
overlaid with the uncompressed graphics obj ect . rendered 
on the presentation graphic plane. 18) output from the 
compositor 28. 

The switch 30 selectively supplies to, the transport 
buffer 20, the TS packets read from the BD-ROM or the TS 
packets read from the local storage 32. 
[0059] 

The network device 31 is used to implement the 
communications f unctionaility of the playback apparatus. 
More specifically, the network device 31 establishes TCP 
connection, FTF' connection, and so on with a web site at 
an URL. 

The local storage 32 is a hard- disk used for storing 
contents supplied, from a various recording media and 
communications media. Contents downloaded from the web 
site via the connection established by the network device 
31 are also stored to the local storage 32. 
[0060] 

The source de-packetizer 34 removes the 
TP_extra_header from each TS packet constituting the AV 
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clip read from the local storage 32 and outputs the TS packets 
without headers to the PID filter 35. The output of the 
TS packets to the PID filter 35 is carried out at the timing 
when the time measured by the arrival time clock counter 
5 33 reaches the ATS shown by the TP__extra_header . 
[0061] 

The PID filter "35 switches to output the TS packets 
read from the local storage 32 to either of the PG stream 
decoder, IG stream decoder, and the audio decoder. 
10 The switch 36 supplies to the audio decoder 39 the 

TS packets read from the BD-ROM or from the local storage 
32. 

The transport buff er (TB) 37 is used to store TS packets 
carrying an audio stream. 
15 [00.62] 

The elementary buffer (EB) 38 is used to store the 
PES packets carxying the audio stream. 

The audio decoder 39 decodes the PES packets output 
from the elementary buffer 38 and outputs uncompressed audio 
20 data. 

The transport buffer (TB) 40 is used to store TS packets 
carrying a text subtitle stream. 
[0063] 

The- elementary buffer (EB) 41 is used to store PES 
25 packets carrying the text subtitle stream. 

The text subtitle decoder 42 decodes PES packets read 
to the elementary buffer 41 and supplies the resulting data 
for presentation. To decode the text subtitle stream, the 



text subtitle decoder 42 expands text strings contained 
in the text subtitle stream into bitmapped data, by applying 
font data separately read from the local s-torage 32. The 
resulting data is written on the presentation graphics plane 
18. 

[0064] 

The scenario memory 43 is used to store current PlayList 
information aind current Clip information. The current- 
PlayList information used herein refers to the currently 
processed PlayList information from among a plurality of ■ 
pieces of PlayList information stored on the BD-ROM. The 
current Clip information used herein refers to the currently 
processed Clip information from among a plurality of pieces 
of Clip information stored on the BD-ROM. 

The controller 4 4 is composed of an instruction ROM 
and a CPU. The controller 44 executes software stored on 
the instruction ROM to carry out overall control of the 
playback apparatus. The control executed on the playback 
apparatus dynamically changes in response to a user event 
generated upon receipt of a user operation and in accordance 
with the values held in each PSR of the PSR set 49. 
[0065] 

The PSR set 46 is a set of non-volatile registers 
provided within the playback apparatus. The set of 
registers include 64 player status registers 
{PSR(1)'-PSR (64 ) ) and 4, 096 general-purpose registers 
(GPRs) . The 64 player status registers (PSRs) each 
represent the current status of the playback apparatus, 
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such as the current playback point. Among the 64 PSRs, 
the values of PSR ( 5 ) -PSR ( 8 ) represent the current playback 
point. Specif i.cally/- PSR (5) -is set to a value from 1-999 
to indicate the chapter number to which the current playback 
5 point belongs . When set to ''OxFFFF" , PSR (5) indicates that 
the chapter numbers are invalid in the playback apparatus. 
[0066] 

PSR (6) is set to. a value from 0-999 to indicate the 
PL number to which the current playback point belongs 
10 (current PL Number) . 

PSR(7) is set to a value from 0-255 to indicate the 
Playltem number to which the current-playback point belongs 
("current PI Number) . 

PSR(8) is set to a value from 0-OxFFFFFFFF and indicates 
15 the current playback point (current PTM) in 4 5 kHz accuracy . 
[0067] 

This concludes the description of the internal 
structure of the playback apparatus. Among the components 
of the playback apparatus , the video decoder 8 and the decoded 

20 picture buffer 10 are of significant importance. Thus, 
a more detailed description thereof will be given with 
reference to Figs. 19-21. 

The decoded picture buffer 10 is used to store a 
plurality of decoded pictures. Fig. 19 illustrates the 

25 internal structure of the decoded picture buffer 10. As 
illustrated in the figure, the decoded picture buffer 10 
stores decoded pictures including reference pictures and 
non-reference pictures. The reference pictures include 



short-term . reference pictures and long-term reference 
pictures. The short-term reference pictures are stored 
to a FIFO memory area and handled in the first-in, first-out 
(FIFO) method. On the other hand, long-term* reference 
5 pictures are not stored to the FIFO memory area and not 
handled in the FIFO method. 
■ [0068] 

Fig. 20 illustrates the decoding process of a Non-IDR 
I picture by the video decoder 8. During the decoding 

10 process of a Non-IDR I picture, ' references are made to the 
long-term reference pictures and the short-term reference 
pictures stored on the decoded picture buffer 10. Arrows 
rfl, rf2r and rf 3 illustrated in the figure schematically 
represent references to the short-term reference pictures, 

15 whereas arrows rjf4, rf5, and rf6. schematically represent 
references to long-term reference pictures. Fig. 21 
illustrates the contents stored in the decoded picture 
buffer 10 at the time of the IDR picture decoding. At the 
time of decoding the IDR picture, the video decoder 8 and 

20 the decoded picture buffer 10 are instantaneously refreshed, 
so that all the short-term and long-term reference pictures 
stored on the decoded picture buffer 10 are erased. This 
concludes the details of the coded picture buffer 7, the 
video decoder 8, and the decoded picture buffer 10. Next, 

25 the following describes the processing steps performed by 
the controller 44. 
[0069] 

The controller 44 controls the BD drive 1 and the video 
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decoder 8 so as to execute fast-speed playback or jump 
playback of an MPEG4-AVC video stream. 

-The fast-speed playback is executed by sequentially 
playing back, out of a plurality of pictures contained in 
5 the video stream, I pictures (including IDR pictures and 
Non-IDR I pictures) . Here, the EP_map shows entry points 
each along with the position and the size of an IDR or Non-IDR 
I picture. Thus, by selectively reading and playing back 
I pictures contained in the video stream, the playback 
10 apparatus can execute trick play of the video stream at, 
for example, a double- or triple-speed. 
[0070] 

There are two types of jump playback: one is time-search 
playback and the other is PL playback. The time-search- 

15 playback is executed upon receipt of timing information 
from a user and playback of a video stream is started from 
a playback point corresponding to a specific time and second 
indicated in the timing information. At the time of 
executing the jump playback, the controller 44 converts 

20 the timing information into the address of an I picture 
stored on the BD-ROM. Then, the controller 4 4 causes the 
" BD-ROM to be read starting from the TS packet at the thus 
obtained I picture address and causes the read TS packets 
to be sequentially supplied to the decoder. 

25 [0071] 

The PL playback refers to playback of a section of 
a video stream between points corresponding to In_time and 
Out_time indicated in PlayList information. 
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The principal part of the above-mentioned playback 
control is a process of deriving an I picture address from 
timing information. Fig. 22 is a flowchart of a process 
of converting timing information into an I picture address . 
In the flowchart, the timing information denoted as In_time 
specifies a jump playback point to be accessed to execute 
jump playback. In a step SI illustrated in Fig. 22, the 
value of In_time is assigned to PTS_EP_start . A step 'S2 
is to calculate a pair of EP_High__ld and EP_Low_id values 
indicating an entry point that is near the PTS_EP_start . 
More specifically, the EP_High_id to be calculated is an 
identifier specifying a nearby .EP_High preceding the 
In_time. On the other hand, the EP_Low_id is an identifier 
specifying an EP_Low indicating a nearby temporal point 
following the EP_High [EP__High_id] and preceding the 
In_time. 
[0072] 

In order to calculate the value of EP_High_id, the 
controller 44 keeps adding the time length of each 
PTS_EP__High included in a plurality of EP_High values until 
the total Yi of the time lengths first exceeds the In_time. 
The time length indicated by each PTS_EP_High is a time 
unit whosemost significant bits are heldby the PTS_EP_High . 
The controller 44 then identifies the k-th EP_High__id that 
results in the total Y, first exceeding the In_time and 
determines the value obtained by {k - 1) as the value of 
EP_High_id. 
[0073] 
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Similarly, to calculate the value of EP_Low_id, the 

controller 4 4 keeps adding, to the total ZI of up to the 
PTS_EP_High (EP_High_id) , the time length indicated by each 
PTS_EP_Low included in EP_Low, until the resulting total 
first exceeds In__t'ime. The controller 44 then identifies 
the h-th EP__Low__id that causes the resulting total to first 
exceeds the In_time, and determines the value obtained by 
(h - 1) as the value of EP_Low__id. 
[0074] 

The pair of EP_High_id and EP_Low_id values specifies 
a nearest entry point preceding the In__time. 

Once the EP_Low_id value is obtained, the controller 
44 enters a loop composed of steps S3-S5 . More specifically, 
the controller 44 assigns the EP_Low_id value to a variable 
J (step S3) and executes the loop composed of the steps 
S4 and S5. In each iteration of the loop, the variable 
j is decremented by ^'1" (step S4) and a judgment is made 
as to whether the is_angle_change_point 

( PTS_EP_Low [ j ] . is_anglB_^change_point) is set to the value 
^^1" (step S5) . The loop is repeatedly executed unit the 
judgment in the step S5 results in YES, i.e. as long as 
the is_angle_change_po±nt field of each entry point is set 
to ^^0". 
[0075] 

That is, the loop is terminated if the entry point 
specified by the variable j has the is__angle_change_point 
set to the value ^^1". When the judgment in the step S5 
results in YES, the controller 44 assigns the value of 
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variable j to the EP_Low_id (step S6) and calculates the 
EP_High[i] having the ref_to__EP_Low_id [ i ] that specifies 
an entry point near the EP_Low__id ( step S7 ) . Once the values 
of the EP_Low_id and the variable i are calculated, the 
5 controller 44 calculates the SPN_EP_Start using the 
SPN_EP__Low [EP_Low_id] and SPN_EP_High [i] values (stepS8) . 
Finally, the thus calculated SPN_EP_start value is. 
converted into an I picture address (step S9) . 
[0076] . 

10 An SPN is a serial number assigned to an individual 

TS packet. In order to read a TS packet having a specific 
SPN, the SPN .needs to-be converted into a relative sector 
number. As illustrated in Fig. 4, TS packets are converted" 
into Aligned Units each containing 32 TS packets, and each 

15 Aligned Unit is recorded in three sectors. Thus, by 
dividing the SPN by 32, the number of the Aligned Unit 
containing the I picture is calculated. Then, by 
multiplying the Aligned Unit number by 3, the sector address 
of the Aligned Unit located near the SPN is calculated. 

20 The sector address . calculated in the above manner is a 
relative sector number counted from the start of one AV 
clip. Thus, by setting the file pointer to the relative 
sector number, the playback apparatus reads the AV clip 
to supply the I picture to the video decoder 8. 

25 [0077] 

Through the above processing, the playback apparatus 
successfully identifies an entry point indicating an IDR 
picture located at a point preceding the In_time. Reading 



of the IDR picture and the following pictures multiplexed 
in the stream ensures that the decoder is supplied with 
all the reference pictures necessary for decoding a picture 
corresponding to the In__time. This concludes the 
5. description of processing for deriving the I picture address 
from timing information. Next, a description is given of 
the playback processing based on PlayList information. 
[0078] 

Fig. 23 is a flowchart of the PL playback performed 

10 by the controller 44. In the description regarding this 
flowchart, the Playltem currently subject to the playback 
processing is denoted as Playltem #x. According to the 
flowchart, first, the current PL information (.mpls) is 
. read (step SlOl), and the steps S102-S110 are - performed . 

15 The steps S102-S110 create a loop in which the steps S103-S110 
are repeated on each piece of PI information included in 
the current PL information. The processing exits from the 
loop when the judgment in the step S109 results in ^'YES". 
The Playltem currently subject to the loop is referred to 

20 as Playltem #x (PI #x) . When set to be the first Playltem 
in the current PL, Playltem #x is initialized (step S102) . 
The terminal condition of the loop described above is 
satisfied when the last Playltem in" the current PL is 
designated as Playltem #x (Step S109: YES) . If there is 

25 another Playltem following Playltem #x in the current PL 
(Step S109, NO) , the next Playltem is designated as a new 
Playltem #x (Step SllO). 
[0079] 



In the steps S103-S110 repeated in the loop, the 
following processing is performed. First, Clip 

informatipn specified by the Clip_inf ormation_f ile_name 
included in the Playltem #x is read to the memory (step 
S103) . The value held in the In_time of the Playltem #x 
is converted into the address u of an I picture, using the 
EP_map associated with the current Clip information (step 
S104 ) . This conversion of In_time into an I picture address 
is carried out in accordance with the flowchart illustrated 
in Fig.. 22 . In this way, the I picture address u indicating 
the address of an IDR picture is calculated. 
[0080] 

Next, the value held in the Out_time of Playltem #x 
is converted into the address v of an I picture, using, the 
EP_map associated with the current Clip information (step 
S105) . The conversion of the Out_time into an I picture 
address is carried out without conducting the processing 
in the flowchart illustrated in Fig. 22. .Rather, the 
conversion is carried out in the following way. First, 
the address of an I picture located at a temporal point 
near the Out__time is designated as the address v. Next, 
the address of the first I picture subsequent to the address 
V is obtained, and the address immediately preceding the 
thus obtained address is designated as an address w (Step 
S107) . Finally, the controller 44 instructs the BD-ROM 
drive 1 to readTS packets starting from the I picture address 
u and ending at the address w (step S108) . 
[0081] 
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On the other hand, the controller 44 instructs the 
video decoder 8 to output pictures starting from a point 
corresponding to the mar k_time_s tamp included in the 
current PlayListMark and ending at a point corresponding 
5 to the Out_time of Playltem #x (step S106) . Through the 
above steps S105-S108, playback of part of the AV clip used 
by Playltem #x is executed. 

Then, it is judged whether Playltem #X' is the last 
PI in the current PlayList (step S109) . 
10 [0082] 

If Playltem#x is not'the last PI in the current PlayList, 
the next Playltem in the current PlayList is designated 
as a new Playltem #x (Step SllO) and the processing returns 
to the step S103. By repeatedly performing the steps 
15 S103-S110 described above, the playback apparatus 
sequentially plays back Playltems constituting the 
PlayList. 

As described above, according to the present embodiment, 
as long as the playback apparatus reads pictures up to entry 

20 point specified by the is__angle_change_point set to the 
value '"1", it is ensured that an IDR picture is supplied 
to the video decoder 8 . That it, all the reference pictures 
necessary for decoding to execute jump playback is made 
available in the decoded picture buffer 10. Thus, the 

25 number of pictures that needs to be read to execute jump 
playback is kept to a minimum. 
[0083] 

As above, even if a video stream is compressed to have 



IDR pictures at relatively long intervals such as fifteen 
minutes or thirty minutes of playback time for the sake 
"of high-compression rate, trick play is efficiently 
executed. That is, without significantly sacrificing the 
5 advantage of high-compression . rate achieved by the 
MPEG4-AVC standard, the playback apparatus is enabled to 
efficiently execute trick play. 

(SECOND EMBODIMENT) 

10 The first embodiment discloses the data structure of 

the EP_map containing the is_angle_^change_point field that 
indicates a point where the playback apparatus can enter 
to the AV clip . A second embodiment of the present invention 
describes an angle change executed by the playback apparatus 

15 with the use of angle changeable points indicated by the 
is_angle_change_point . As described in the first 
embodiment, the processing of angle change is composed of 
^^exiting" from the currently executed AV clip and entering" 
into another AV clip. 

20 [0084] 

Suppose, for example,, the BD-ROM stores a plurality 
of AV clips containing video images of the same subject 
shot from different camera angles, for example, the front, 
right, and left . During playback of the AV clip containing 
25 images shot from the front, the playback apparatus may ^^exit" 
from the current AV clip and ^^enter" to the AV clip containing 
images short from the right. As a result, the playback 
angles are changed from the front to the right. Since the 



playback images are changed as if a camera angle is changed, 
the above processing composed of ^^exiting" from an AV clip 
and ^'entering" to another AV clip is referred to as '''angle 
change". In order to implement the .'^angle change" 
5 functionality, some improvements need to be made on AV clips 
and PlayList information. The improvement is embodied in 
the structure called a multiangle section defined by 
PlayList information containing Playltem information and 
using a plurality of AV clips. 
.10 [0085] 

Fig. 24 illustrates an application layer layout 
implementing a multiangle section. In the . present 
embodiment, a multiangle section contains four angles. 
Thus, the multiangle section is composed of four AV clips 
15 (00001. m2ts, 00002. m2ts, 00003. m2ts, and 00004 . m2ts ) , one 
piece of PlayList information ( 00001 .mpls and four pieces 
of Clip information (00001. dpi, 00002. clpi, 00003. dpi, 
and 00004 .dpi) . 
[0086] 

20 Fig. 25 illustrates the data structure of PlayList 

information. As illustrated in the figure, each piece of 
Playltem information constituting the multiangle section 
includes two portions: one is a portion compatible with 
a non-multiangle Playltem and the other is an extended 

25 portion used for implementing a multiangle section. The 
compatible portion is identical in data structure to the 
Playltem information illustrated in Fig. 16. More 
specifically, the compatible portion is composed of 



''Clip_inf ormation_f ile__name'', ''Clip_codec_identif ier" , 
''In_time'', and ''Out_time". The AV clip specified in the 
compatible portion constitutes the first angle section in 
the multiangle section. With this- structure, a playback 
5 apparatus not capable of handling a multiangle section (a 
playback apparatus capable of handing BD~RE data structure 
only) is enabled to read Playltem information containing 
. multiple angles and duly execute playback of the first angle 
sectionby simply manipulating the compatible portion. The 
10 extended portion is composed of the following fields: 
^'is__multi_angles"; ^^number_of_angles"; 
^'is_seamless_angle_change"; and ^^Angle information [2] 
[3] -...[j]". 
[0087] 

15 The ^'is_multi_angles" field indicates whether the 

playback section used by this Playltem is a multiangle 
section or non-multiangle section. 

The ^^number_of_angles" field indicates the number of 
angles contained in the multiangle section, if the 

20 ^^is_multi_angles" field is set to the value indicating a 
multiangle section. 

The '''is_seamless_angle_change" field indicates 
whether the multi-angle section is prepared for seamless 
angle change. Whether or not the angle change is to be 

25 seamless is determined depending on whether the AV clip 
is interleaved or not. In the case of an AV clip that is 
interleaved, the ^^is_seamless_angle_change" is set to ^'ON" . 
On the other hand, in the case of an AV clip that is not 



interleaved^ the ^'is_seamless_angle_change" is set to 
[0088] 

Each piece of ^^Angle info [2]-[j]" relates to an 
individual angle section contained in the multiangle 
section and includes the following fields: 
^^Clip__Info rma t i on_f i 1 e_name and 
^^Clip__codec_identif ier''.. 

The ^'Clip_lnf ormation_f ile_.name [angle__id] " field 
indicates the file name containing an AV clip used in the 
angle section. 

The ^'Clip_codec_identif ier [angle_id]" field 
indicates the codec of the AV clip contained in the file 
specified by the Clip_Inf ormation^f ile_name field. 
[0089] 

As. described above, the ^^Angle info'' contains neither 
^^In_time" nor ^^Out_time" . It is because the In_time and 
Out_time included in the compatible portion collectively 
specify the start and end points of each of the second and 
the following angle sections. That is to say, every AV 
clip specif ied by the Clip_Inf ormation_f ile_name contained 
in a respective piece of Angle information in the extended 
portion needs to have the same playback time with the AV 
clip specified by the Clip_Inf ormation_f ile_name in the 
compatible portion. In addition, the timestamps (System 
Time Clock) specifying the playback timing of the respective 
AV clips on the playback timeline need to be the exactly 
same value. 
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[0090] 

Both the compatible and extended portions of Pla.yltem 
information have the Clip_Inf ormation_f ile_name field. - 
Thus, a playback section of each of a plurality of AV clips 
5 is specified all at once. 

Fig. 26A illustrates the playback sections of a 
plurality of AV clips collectively specified by the four 
Clip^Inf ormation_f ile_name . fields contained in- the 
Playltem information. In the figure, the first level 
10 illustrates four timelines of the four AV clips (AV clips 
#1, #2, #3, and #4). The fifth level illustrates the PL 
. timeline. The four Clip_Inf ormation_f ile_name fields 
included in the Playltem information specify the four 
timelines. With this data structure, the In_time and 
15 Out_time- of the Playltem define four playback sections that 
are selectable for playback. That is, a section composed 
. of a plurality of selectable angle images (so-called a 
multiangle section) is defined on the PL timeline. The 
four playback sections of the four AV clips specified by 
20 the In_time and the Out_time are located at the same position 
on the PlayList timeline. 
[0091] 

The following describes how the AV clips used to 
constitute a multiangle section is divided on a BD-ROM. 
25 Each AV clip is stored on the BD-ROM in units called extents . 
An extent is one divided portion- that is recorded in a 
contiguous area on the BD-ROM and is also referred to as 
a ^'segment". 



Suppose, for example, AV clips #l-#4 illustrated in 
Fig. 24 contain video data of motion picture images shot 
from four different angles . In this case, each of AV clips 
#l-#4 are divided into five extents as follows: 
5 AV clip #1 ^ 

AV clip #1.1/5, AV clip #1.2/5, AV clip #1.3/5, AV 
clip #1.4/5,. and AV clip #1.5/5 

AV clip #2 - 

AV clip #2.1/5, AV clip #2.2/5, AV clip #2.3/5, AV 
10 clip #2.4/5, and AV clip #2.5/5 
AV clip #3 - 

, AV clip #3.1/5, AV clip #3.2/5, AV clip #3.3/5, AV 
clip #3.4/5, and AV clip #3.5/5 
AV clip #4 - 

15 AV clip #4.1/5, AV clip #4.2/5, AV. clip #4.3/5, AV 

clip #4.4/5, and AV clip #4.5/5 ^ 

Fig. 26B illustrates the extents of each AV clip on 
the PlayList timeline. The five extents of each AV clip 
are located at the same positions on the playback timeline 

20 with the counterpart extents of the other AV clips. More 
specifically, AV clip #1 . 1/5 , AV clip #2 . 1/5 , AVclip #3 . 1/5, 
and AV clip #4.1/5 are all located at the same position 
on the timeline. Likewise, AV clip #1 . 2/5, AV clip #2 . 2/5, 
AV clip #3.2/5, and AV clip #.4.2/5 are all located at the 

25 same position on the timeline. AV clip #1.3/5, AV clip 
#2.3/5, AV clip #3.3/5, and AV clip #4.3/5 are all located 
at the same position on the timeline. 
[0092] 
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The- extents of the four AV clips are^ recorded onto 
the BD-ROM by interleaving. Interleaving is a technique 
of recording multiple files, so that each file is divided 
into a plurality of extents and that extents with the same 
5 playback timing are alternately recorded on the BD-ROM. 
Owing to the interleaving, the playback apparatus currently 
reading a file can suitably switch to read another file. 
Thus, the playback apparatus is enabled to ^^exif from the 
currently played AV clip and ^'enter'' into another AV clip 
10 without interrupting playback, thereby to execute seamless 
angle change. 
[0093] 

The extents illustrated in Fig. 26B are interleaved 
on the BD-ROM as illustrated on Fig. 2.7A. 

15 Fig . 27A is an allocation image showing the arrangement 

. of the four AV clips constituting the multiangle section 
on the BD-ROM. As described above,' each of the four AV 
clips is divided into five extents. The first extents of 
the respective AV clips (AV clip #1.1/5, AV clip #2.1/5, 

20 AV clip #3 . 1/5, andAVclip#4 . 1/5) are contiguously recorded . 
Those extents AV clip #1.1/5- AV clip #5.1/5 are all part 
of the AV clips to be played back in the same playback period . 
That is, all the extents corresponding to the same playback 
period are collectively and contiguously recorded on the 

25 BD-ROM. The extents of AV clip #1 and of AV clip #2 are 
arranged in series on the BD-ROM. Thus, by reading AV clip 
#1.1/5 together with AV clip #2 . 1/5, either of AV clip #1.1/5 
and AV clip #2 . 1/5 can be selectively decoded. This makes 



it possible to implement angle change in response to a user 

operation. 

[0094] 

The multiangle section of an AV clip is divided into 
5 a plurality of portions at boundaries residing on points 
of ''entering" and ^'exiting'' described in the first 
embodiment. That is, the; start and end points of each 
divided portion coincide with an entering point and an exit 
point. Since a plurality of divided portions each start 

10 with an entering point and ends with an exit point are 
linearly- arranged, entering points and exit points 
alternate. This arrangement helps the playback apparatus 
to' suitably exit from an AV clip and enter into another 
AV clip. 

15 [0095] 

Fig. 27B illustrates the internal structure of one 
extent of an AV clip. As illustrated in the figure, the 
first NAL unit (or the first piece of video data) contains 
an Access Unit Delimiter (AUD) followed by an IDR picture, 

20 which is an independently decodable Access Unit. The PTS 
and SPN of the IDR picture are specified by the entry point 
having the is_angle_change_point field set to the value 
^'1". No extent should be shorter than a predetermined 
length for the following reason . When read from the BD-ROM, 

25 an extent shorter than the predetermined length may cause 
the buffer to underflow. 
[0096] 

One extent may have more than one IDR pictures, each 
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of which serves -as an entering point. Yet, the length of 
the extent between the last IDR picture and the end of the 
extent should not be shorter than the predetermined length 
mentioned above. Fig. 28 illustrates the concept of how 
5 to determine the contiguous length to the extent. In the 
figure, entry points #l-#5 have the is_angle_change_polnt 
fields set to the values ^^1", ^^0", ''0'\ and ^^1'' in 

the stated order. Thus, the length from entry point #5 
to the end of the extent should not be shorter than the 
10 predetermined length. 
[0097] 

Fig. 29 illustrates the allocation of the extents on 
the BD-ROM, along with the entry point setting. In the 
figure, the shaded portions represent the Access Unit 

15 Delimiter of an I picture (IDR picture or Non-IDR I picture ) 
located at the start of each extent constituting AV clip 
#2. Note that the I pictures (IDR pictures or Non-IDR I 
pictures) located at the start of AV clips #3, #4, and #5 
are not illustrated for the sake of simplicity in the 

20 illustration. In the case where the extents constituting 
AV clip #2 (AV clip #2.1/5, AV clip #2 . 2/5 , AV clip #2 . 3/5, 
AV clip #2.4/5, and AV clip #2.5/5) are interleaved with 
the extents of another AV clip^ the EP_map contained in 
the Clip information associated with AV clip #2 is set to 

25 indicate the five entry points #1 , #2, #3, #4, and #5. Entry 
points #1, #2, #3, #4, and #5 are indicated in correspondence 
with the SPN and PTS values of a corresponding one of AV 
clip #2.1/5, AV clip #2 .2/5, AV clip #2 . 3/5, AV clip #2 , 4/5, 



and AV clip #2.5/5. 
[0098] 

Suppose, for example, among the five extents of AV 
clip #2, the first pictures in AV clip #2 . 2/5, AV clip #2 . 4 /5, 
5 AV clip #2.5/5 are Non-IDR I pictures, whereas the first 
pictures in AV clip #2 . 1/5 and AV clip #2 . 3/5 are I DR pictures . 
In that case, the is_angle_change_point is set to the value 
^'1" for each entry point #1 and #3, which correspond to 
the SPNs of AV clip #2 . 1/5 and AV clip #2 . 3/5, respectively. 

10 As described above, the start of each extent of AV 

clip #2 is indicated by entry points whose 
. is_angle_change_^point is set to the value ^^1''. With this 
setting, the start point of such an extent is regarded as 
an entering point, which is a point at which the playback 

15 apparatus can enter into the AV clip. Since the end point 
of an extent immediately precedes an extent with 
is_angle_change_point^' set to the value ^^1'', the end point 
is regarded as an exit point, which is a point at which 
the playback apparatus can exit from the AV clip. Fig. 

20 29 illustrates the entry points set on the extents of AV 
clip #2. Similarly to the extents of AV clip #2, the start 
point of each extent of AV clips #1, #3, #4, and #5 is indicated 
by an entry point with the is_angle_change_point set to 
the value ^'1". Since the playback apparatus is enabled 

25 to exit from, and enter into AV clips #1, #2, #3, #4, #5 
at a boundary between the end point of an extent and the 
start point of another extent, seamless angle change is 
guaranteed . 



[099] 

This concludes the description of the improvement made 
on the recording medium according to the present embodiment . 
Next, a description of an improvement made on the playback 
5 apparatus wi 11 be given . According to the second embodiment , 
the playback apparatus indicates an angle • section with 
PSR(3) included in the PSR set 46. PSR(3) is used to store 
a value indicating the current angle. The controller 4 4 
of the playback apparatus according to the second embodiment 
10 causes the angle section to be selected for playback, in 
accordance with the value held in PSR (3). 
[0100] . 

Fig, 30 illustrates the valid values of PSR (3) and 
the relationship with Playltem and Clip information. The 

15 leftmost block of the figure illustrates the values (1-4) 
of PSR (3) . ■ 

When PSR(3) is set to the value ""1", the playback 
apparatus reads the Clip information specified by the 
Clip_inf ormation_f ile_name in the compatible portion of 

20 the Playlteminf ormation. As a result, the Clip information 
contained in the file called ^^00001 . dpi" is read to the 
memory. The playback apparatus then refers to the entry__map 
contained in the read Clip information and executes playback 
of the AV clip (00001 .m2ts) . 

25 [0101] 

Similarly, when PSR(3) is set to the value '^2", the 
playback apparatus reads the Clip information specified 
by the Clip^inf ormation__f ile^name in Angle information [ 2 ] 



of the Playltem information. As a result, the Clip 
information contained in the file called ^^00002 . dpi" is 
read to the memory. The playback apparatus then refers 
to' the .entry_map contained in the read Clip information 
and executes playback of the AV clip ( 00002 .m2ts ) . 

When PSR(3) is set. to the value ''3'\ the playback 
apparatus reads the Clip information specified by the 
Clip_inf ormation_f ile_name in Angle information [3 ] of the 
Playltem information. As a result, the Clip information 
contained in the file called ''00003 . dpi" is read to the 
memory . The playback apparatus then refers to the entry_map . 
contained in the read Clip information and therefore 
executes playback of the AV clip ( 00003. m2ts) . 
[0102] 

When PSR(3) is. set to the value 'M", the playback 
apparatus reads the Clip information specified by the 
Clip_inf ormation_f ile_name in Angle information [4 ] of the 
Playltem information. Thus, the Clip information 
contained in the file called ''00004. dpi" is read to the 
memory. The playback apparatus then refers to the entry_map 
contained in the read Clip information and therefore 
executes playback of the AV clip ( 00004 .m2ts ) . 

The following describes the processing steps performed 
by the controller 44 in accordance with the Playltem 
information illustrated in Fig. 25. Fig. 31 is a flowchart 
of processing steps performed to execute of PlayList 
playback according to the second embodiment. 
[0103] 
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This flowchart is basically identical to the flowchart 
illustrated in Fig. 23, except for that the step S103 is 
replaced with steps S111-S114 . More specifically, in or<ier 
to execute playback of one of Playltems contained in the 
current PlayList information, the controller 44 assigns 
the value held in PSR(3) to a variable V (step Sill) and 
judges whether the variable V is greater than or equal to 
^^2" (step S112) . If the variable V is equal to ^^1" (step 
S112: NO), the Clip information specified by the 
Clip_inf ormation_f ile_name in the compatible portion of 
the Playltem is read to the memory (step S113) . Then, the 
controller 4 4 controls the BD-ROM drive 1 to read a sequence, 
of TS packets, from the point corresponding to the In^time 
to the point corresponding to the Out_time of Playltem #x 
(steps S104-S108) . 
[0104] 

If the variable Vis greater than or equal to ^^2" (step 
S112: YES), the Clip information specified by the 
Clip_inf ormation_f ile_name in the Angle information [V] of 
Playltem #x is to the memory (step S114). Then, the 
controller 4 4 controls the BD-ROM drive 1 to read a sequence 
of TS packets from the point corresponding to the In_time 
to the point corresponding to the Out_time of Playltem #x 

(steps S104-S108)o 

As described above, by accessing a different AV clip 
in accordance with the value of PSR{3), the playback 
apparatus executes playback of a requested angle section. 
[0105] 
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Fig. 32 is a flowchart of processing steps performed 
to read a multiangle section from a disc. In the following 
description relating to the figure, the term current 
address'' refers to.an address of a point on a disc currently 
read by. the optical pickup. The term ^'current extent" 
refers to the extent containing the current address. The 
term ^^current angle" refers to a currently played angle 
contained in the multiangle section. 
[0106] . 

The steps S50-S52 constitute a main loop of the 
flowchart. In each iteration of the loop, the current 
address is updated to the next address (step S50) . 

By repeating the steps S50-S52, the current address 
is successively updated to the next address within one 
extent. 
[0107] 

In the step S51, it is judged whether an angle change 
is requested. An angle change is requested at a push of 
an angle key or numeric key on the remote controller. If 
an angle change is requested, . the value indicating the 
requested angle is assigned to the variable V (step S53) 
.and the preparation flag is set to the value ^""l" (step S54) . 

Here, if the angle change is requested at a push of 
the angle key, the value obtained by adding^' 1" to the PSR (3) 
value is assigned to the variable V, On the other hand, 
if the angle change is requested at a push of a numeric 
key, the value corresponding to the numeric key is assigned 
to the variable V. 
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[0108] 

In the step S52, it is judged whether the current address 
has reached the end address -of the current extent. The 
judgment in the step S52 results in ""YES" when all the TS 
packets of the current extents are read and thus the current 
address reaches the end point of the extent. 

If the judgment in the step S52 results in ''YES", the 
steps S55-S57 are performed. In the step 555, it is judged 
whether the. preparation . flag is set to the value ''1''. If 
the preparation flag = ''0", the next extent in the current 
AV clip is set as a new current extent (step S56) , and the 
.address of the first-Access Unit Delimiter in the new current 
extent is set to be a new current address (step S57) . Then 
the loop composed of the steps S50-S52 is performed again. 
That is, as long as the preparation flag is equal to '"0", 
the next extent in the current angle is read. 
[0109] 

On the other hand, if the preparation flag is set to 
the value ''1'% the AV clip to be read is switched as follows . 
This is because the AV clip of the requested angle is started 
to be read at the timing when the current address reaches 
the end of the current extent. 

In order to switch the AV clips to be read, first of 
all, among the extents of the requested angle section, the 
extent that immediately follows the current extent in the 
presentation order is designated as an extent dst (step 
S58) . Then, the Eptop indicating the first Access Unit 
Delimiter in the extent dst is identified (step S59) . Then, 

61 



it is judged whether the is_^angle_change_point of the EPtop 
is set to the value ^"1" (step S60) . This judgment is made 
to see whether t hie start point of the extent dst is a point 
where the playback apparatus can enter to the AV clip. If 
5 the is_angle_change_point is set to the value '"0", the step 
S56 is performed with the preparation flag maintained to 
the value ^^1", .Through the steps S56-S57, the next extent 
in the current angle is read,, and playback of the current 
angle is continued. In other words, playback of the current 
10 angle is continued as long as the extent dst is in condition 
where the point is_angle_change__point is not set to the 
value ''M'', i.e. as long as the extent dst is not a point 
where the playback apparatus can enter to the AV clip. 
[0110] 

15 If the is__^angle_change_point is set to the value ^^1", 

the extent dst is designated as a new current extent (step 

561) , and the address of the first Access Unit Delimiter 
in the extent dst is set as a new current address (step 

562) . Then, the preparation flag is cleared to ""'O'', and 
20 PSR(3) is set to the variable V indicating the requested 

angle (step S63) . Then, the processing returns to the step 
S113. As a result. Clip information specified by the 
Clip__inf ormation_f ile_name corresponding to the variable 
is read and playback is continued in accordance with the 
25 thus read Clip information. 
[0111] 

Fig. 33 illustrates a process of reading the BD-ROM 
for executing playback of an angle image A. As illustrated 



in the figure, five extents (AV clip #1 . 1/5, AV clip #1 . 2/5, 
AV clip #1.3/5, AV clip #1.4/5, and AV clip #1.5/5) of AV 
clip #1 are sequentially read. 

Fig. 34 illustrates a process of reading the BD-ROM 
5 pierformed upon receipt of a user operation of requesting 
an angle change. As illustrated in the figure, a user 
operation requesting an angle change* is received during 
the time AV clip #1.2/5 of AV clip #1 is being read (step 
S5: YES). In response to- the user operation, the 

10 preparation flag is set to the value ^'1" (step S54) . The 
user operation received herein is to request an angle change 
from the angle, image presented by AV clip #1 to an angle 
image presented by AV clip #2. Since the angle change is 
requested during the time AV clip #1.2/5 is being read, 

15 AV clip #2.3/5 is designated as the extent dst, which is 
the extent that immediately follows the current extent in 
the presentation order (step S58) . The start point of the 
extent dst is specified by entry point #3 corresponding 
to the PTS_EP_start indicating the temporal point t3. Thus, 

20 a reference is made to the is_angle_change_point 
corresponding to entry point #3 of AV clip #2 (step S60) . 
In this case, the is_angle_change_point of entry point #3 
is set to the value ^^1". That is to say, entry point #3 
is a point where the playback apparatus can enter to the 

25 AV clip. Thus, the extent dst (i.e. AV clip #2.3/5) is 
set as a new current extent (step S61), and the address 
of the first Access Unit Delimiter in the new current extent 
is set as a new current address (step S62). Then, PSR(3) 



is set to the value "'2" specifying AV clip #2 (step S64) • 
As a result, AV clip #2.3/5, AV clip #2.4/5, AV clip #2.5/5 
of AV clip #2 are sequentially read. 
••[0112] 

5 Fig. 35 illustrates a process of reading the BD-ROM 

performed upon receipt of a user operation of requesting 
an angle change. As illustrated in the figure, a user 
operation requesting an angle change is received during 
the time AV clip #1.1/5 of AV clip #1 is being read (step 

10 S51: YES). In response to the user operation, the 
preparation flag is set to the value """l" (step S54) . Since 
the angle change is requested during the time AV clip #1 . 1/5 . 
is being read, AV clip #2.2/5 is designated as the extent 
dst (step S58). The start point of the extent dst is 

15 specified . by entry point #2 corresponding to the 
PTS_EP_start indicating the temporal point ■t2. Thus, a 
reference is made to the is_angle_change_point. 
corresponding to entry point #2 of AV clip #2 (step S60) . 
In this case, the is_angle_change_point of entry point #2 

20 is set to the value ^'0". That is to say, entry point #2 
is not a point where the playback apparatus can enter to 
the AV clip. Thus, AV clip #1.2/5, which is the extent 
next to AV clip #1.1/5 in the current AV clip.#l, is set 
as a new current extent (step S56) . Then, the address of 

25 the start point of the current extent is set as a new current 
address (step 857) . As a result, AV clip #1.2/5 is read. 
[0113] 

When the current address reaches the end of AV clip 
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#1.2/5 ( step S52 : YES) , it is j udged whether the preparation 
flag is set to the value ^^1" (step S55) . Since the 
preparation flag is set to the value ^^1'' in this case, the 
judgment in the step S52 results in ^"YES". Thus, AV clip 
5 #2 . 3/5 is now designated as the extent dst (step S56) . The 
start point of the extent dst is specified by entry point. 
#3 corresponding to the PTS_EP_start indicating the 
temporal point t3. Thus, a reference is made to the 
is_angle_change_^point of entry point #3 of AV clip #2 (step 

10 S60) . In this case, the is_angle_change_point of entry 
point #3 is set to the value ^^1". That is to say, entry 
point #3 is a point where the playback apparatus can enter 
to the AV clip. Thus, AV clip #2,3/5 designated as the 
extent dst is set as a new current extent (step S61), and 

15 the address of the first Access Unit Delimiter in the current 
extent is set as a new current address (step S62) . Then, 
PSR(3) is set to the value ^"2" specifying AV clip #2 (step 
S64) . As a result, AV clip #2.3/5, AV clip #2.4/5, AV clip 
#2.5/5 of AV clip #2 are sequentially read. 

20 [0114] 

As in the example illustrated in Fig. 35, there may 
be a case where the extent of the requested angle located 
on the PL timeline immediately after the point of the angle 
change request is not an entering point.. In such a case, 
25 playback of the extents presenting the current angle is 
continued until an angle changeable point is reached. 

In addition, an angle change to AV clip #2.3/5 is 
possible until the playback start of the extent of AV clip 



#1 (AV clip #1.3/5) that is located at the same point on 
the PlayList timeline. In other words, once playback of 
the extent of AV clip #1 (AV clip #1.3/5) is started, an 
angle change to AV clip #2.3/5 is no longer possible. 
5 [0115] 

As described above, according to the present embodiment, 
the start point of each of a plurality of extents constituting 
an AV clip is indicated by an entry point. In addition, 
with reference to the is_angle_change_point field of a 

10 respective entry point, the playback apparatus can readily 
identify which of such entry points are the points where 
the playback apparatus can enter to the AV clip of a requested 
angle image. By supplying to the decoder the IDR picture 
located at an entering point, the playback apparatus can 

15 smoothly execute an angle change even if the video stream 
is an MPEG4-AVC stream. 

[0116] 
■ (THIRD EMBODIMENT) 

20 The first embodiment relates to the improvement for 

efficiently executing jump playback of a video stream 
including IDR pictures at 15- or 30-minute intervals. In 
contrast, a third embodiment of the present invention 
relates to a technique of allowing selection as to which 

25 of pictures contained in a video stream is encoded to be 
IDRpictures . In other words, the present embodiment allows 
selection to be made at the time of setting encoding 
conditions, so that optimal pictures are encoded as IDR 



pictures. An MPEG4-AVC video stream is encoded with the' 
MPEG4-AVC standard and referenced by PlayList information 
via Clip information. The present embodiment allows the 
selection of IDR pictures in view of this nature of PlayList 
information. 
[0117] 

Hereinafter, a description is given of the data 
structure of PlayList information according to this 
embodiment. Fig. 36 illustrates the internal structure 
of PlayList information according to the third embodiment. 
The PlayList information illustrated in the figure differs 
from the PlayList information of. the second embodiment in 
that PLMark (PLMark #l-#n) is additionally contained. The 
selection of IDR pictures is implemented in order to more 
efficiently execute PL playback of PlayList information 
having such a data structure. 
[0118] 

PLMark information ( PLMark () ) illustrated in Fig. 36 
specifies an arbitrary section on the PL timeline as a chapter 
point. As leader lines pml in Fig. 36 indicate, the PLMark 
information includes the following fields: 
^'ref_to_PlayItem_id" and ''mark_time_stamp" . Fig. 37 
illustrates chapters defined by the PLMark information. 
In the figure, the first level illustrates the AV Clip 
timeline, whereas the second level illustrates the PL 
timeline. An arrows pkl and pk2 represent that two pieces 
of PLMark information each specify a Playltem (by 
ref_to_PlayItem_id) and a point (specified by 
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mark_time__stamp) . As a result, the PLMark information 
defines three chapters (Chapter#l, #2, and #3) on the PL 
timeline. This concludes the description of the PLMark 
information. 
5 [0119] 

Fig. 38 illustrates pictures of the video stream used 
by Playltem #1 contained in PlayList information, together 
with the relevant part of the entry__map setting. Suppose, 
for example, the In_time of Playltem #1 specifies a temporal 

10 point t2 on the timeline . In this case, the picture located 
at the temporal point t2 is encoded to be an IDR picture. 
As a result, at the time of executing PlayList information 
playback, playback in accordance with PlayList #1 is 
correctly executed simply by reading pictures starting from 

15 the picture located at the In__time of Playltem #1. 
[0120] 

Fig. 39 illustrates pictures of the video stream used 
by Playltem #2. The picture specified by. the In_time of 
Playltem #1 is an IDR picture. Yet, the picture specified 

20 by the In_time of Playltem #2 may or may not be an IDR picture . 
That is, except for the first piece of Playltem information 
in the PlayList information, it is not necessary that the 
picture specified by the In_time of a respective piece of 
Playltem information be an IDR picture. Rather, each of 

25 such pictures may be encoded as a Non-IDR I picture. It 
is because the MPEG4-AVC format allows one reference picture 
to be used over a relatively long term. For example, 
pictures located between In_time and Out_time of Playltem 



#2 as well as pictures located between In_time to Out_time 
of Playltem #3 are encoded using a long-term reference 
picture located between -In_tiine to Out_time of Playltem 
#1 . As a result, it is not necessary to place an IDR picture 
5 at the In_time of Playltem #2 or at the In_time of Playltem 
#3. Encoding with the use of long-term reference pictures 
advantageously reduces the number of IDR pictures. Thus, 
an MPEG4-AVC video stream is encoded at a high compression 
rate. It should be noted, however, that the first Playltem 

10 in the PlayList information has no preceding pictures to 
be used as reference. Thus, at the time of executing 
playback starting from the In_time of the first Playltem, 
the decoded picture buffer 10 is supplied with no reference 
picture. That is, the picture specified by the In_time 

15 . of the first Playltem needs to be encoded as an IDR picture . 
[0121] 

Among a plurality of pictures located between the 
In_time and the Out_time of Playltem information #2, the 
picture specified by PLMark #1 needs to be encoded as an 

20 IDR picture . Each picture specified by PLMark information 
is regarded as a chapter point. When chapter search is 
executed to start jump playback from a picture specified 
by PLMark information, the decoded picture buffer 10 is 
supplied with no reference picture. Thus, each I picture 

25 specified by PLMark information needs to be an IDR picture. 
[0122] 

Fig. 40 illustrates pictures of the video stream used 
by Playltem #3 . Similarly to Fig . 39, the picture speci f led 



by the In^time of Playltem #3 illustrated in Fig. 40 may 
or may not be an IDR picture. Yet^ the picture specified 
by. PLMark #3 needs to be encoded as an IDR picture. As 
a consequence, PLMark playback can be suitably executed, 
since no reference picture is used to start playback from 
the chapter. 
[0123] 

This concludes the description of the improvement made 
on the recording medium according to the present embodiment . 
Next, a description is given of an improvement made on the 
playback apparatus according to the present embodiment. 
The processing steps to execute PlayList playback are 
basically identical to those described in relation to the 
first embodiment. The PlayList playback is executed by 
converting the In_time and the Out_time indicated in 
PlayList information to I picture addresses. 

Among a plurality of pieces of Playltem information 
included in PlayList information, the first piece of 
Playltem information has the In_time specifying an IDR 
picture . Since such an IDR picture is indicated by an entry 
point with the is_angle__changB_point field set to the value 
^'1''. Thus, by reading the pictures starting from the point 
specified by the SPN_EP_start of the entry point 
corresponding to the In_time, the controller 4 4 can ensure 
that an IDR picture is supplied to the video decoder 8. 
In response to that an IDR picture is supplied to the video 
decoder 8, the decoded picture buffer 10 is cleared. 
[0124] 
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As described above, the playback apparatus according 
to the present embodiment is not required to search an entry 
point close to the In__time . Rather, the playback apparatus 
o^ the present embodiment is able to supply an IDR picture 
to the video decoder 8 simply by reading a point corresponding 
to the In_time on the BD-ROM. As a result, PL playback 
is executed at a higher speed. 

In addition, since PLMark information defines chapters, 
•the playback apparatus according to the present embodiment 
is able to execute, using PlayList information, a chapter 
search function and chapter skip function . With the chapter 
search function, the playback apparatus first specifies 
Playltem information referred to by the ref_to_PlayItem_id 
included in the PLMark information . The playback apparatus 
then executes jump playback of the AV clip that. is used 
by the thus specified Playltem information, starting from 
a point specified- by the mark_time_stamp included in the 
PLMark information. To this end, the controller 44 
specifies one of a plurality of entry points having the 
PTS_EP_start value close to the mark_time_stamp value 
included in the PLMark information. The controller 4 4 then 
causes playback to be started from the I picture address 
corresponding to the SPN_EP_star.t of the thus specified 
entry point. 
[0125] 

With the chapter skip function, the playback apparatus 
specifies PLMark - information defining a chapter that is 
immediately before or after the chapter containing the 
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current playback point. The playback apparatus then 
conducts a search of chapters defined by the thus PLMark 
information. As described above, each picture specified 
by the mark_time_stamp in the PLMark information has been 
encoded to be an IDR picture. Each entry point with the 
is_angle_change_point field set to the value' ^'1" has the 
PTS_EP_start value indicating the playback time of an IDR 
picture. Thus, by reading the pictures starting from the 
point specified by the SPN_EP_start value of any of such 
entry points, the playback apparatus can ensure that an 
IDR picture is supplied to the video decoder 8. 
[0126] . 

The following describes the processing steps of 
executing the chapter search and chapter skip functions, 
with reference to flowcharts. .Fig. 41 is a flowchart of 
the processing steps of the chapter search function. 

According to the flowchart, first, the playback 
apparatus is placed in a stand-by mode for a user operation 
of selecting a chapter on a chapter menu (step S124) . Upon 
receipt of a user operation of selecting. a chapter, the 
PLMark information defining the selected chapter is 
designated as current PlayListMark (step S125) . In a step 
S126, the PI specified by the ref_to_PlayI tem_id field in 
the current PlayListMark is. designated as Playltem #x. In 
a step S127, the Clip information specified by the 
Clip_inf ormation_f ile_name of Playltem #x is read. In a 
step S128, the mark_time_stamp value of the current 
PlayListMark is converted to the I picture address u, using 
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the EP_map associated with the current Clip information. 
Here, the picture specified by the mark^time^stainp value 
of the PLMark information is indicated by an entry point 
with the is_angle_change_point field set to the value ^'1''. 
That is, the I picture address u is the address of an IDR 
picture. 
[0127] 

In a step S129, the Out_time of Playltem #x is converted 
into an I picture address v, using the EP_map associated 
with the current Clip information. In a step S130, the 
playback apparatus instructs the decoder to output TS 
packets starting from the point corresponding to the 
mark_time_stamp value of the current PlayListMark and 
ending at the point corresponding the Out_time of Playltem 
#x. Through the above steps, the playback apparatus 
converts the I picture addresses u and v and then goes back 
the step S107 illustrated in Fig . 23. As a result, TS packets 
of an AV clip that is different from the currently read 
AV clip are caused to be read, so that playback is switched 
to the requested chapter. This concludes the description 
of the processing steps for executing the chapter search 
function. Next, a description of processing steps for the 
chapter skip function will be given. Fig. 42 is a flowchart 
of the processing steps of the chapter skip function. 
[0128] 

In a step S131, the playback apparatus is placed into 
a stand-by mode for a user operation made on a SkipNext 
key or a SkipBack key provided on the remote controller. 
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Upon receipt of a user operation, a step S132 is performed 
to judge whether SkipNext key or the SkipBack key is pushed. 
If the SkipBack key is pushed, the direction flag is set * 
to the value ^'-1" in a step S133. On the other hand, if 
the SkipNext key is pushed, the direction flag is se. to 
the value ^^ + 1" in a step S134. 
[0129] 

In a step S135, the value held in the direction flag 
is added to the current PlayListMark number and the addition 
result is set as a' new current PlayListMark number. In 
the case where the SkipNext key is pushed in the step S131, 
the direction flag is. set to the value ^' + 1", Thus, the 
current PlayListMark number is incremented. On the other 
hand, in the . case where the SkipBack key is pushed in the 
step S131, the direction flag is- set to the value ^'-1". 
Thus, the current PlayListMark number is decremented. 
After the PLMark information is set as above, the same 
processing steps S126-S130 as described in Fig. 41 are 
performed to read suitable TS packets. 
[0130] 

Here, the picture specified by the mark_time__stamp 
of the PLMark has been encoded as an IDR picture. Thus, 
each entry point with the is_angle_change_point field set 
to the value '"1" has the PTS_EP_start value indicating the 
presentation time of an IDR picture. By reading the 
pictures starting from the point specified by the SPN of 
such an entry point, the playback apparatus can ensure that 
an IDR picture is duly supplied to the video decoder 8. 
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[0131] 

According to the present embodiment, as described above, 
an AV clip is encoded so as to insert IDR pictures at the 
point specified by the In_time of the first Playltems in 
5 PlayList information and at the chapter points specified 
by PLMark information. This arrangement eliminates the 
need for the playback apparatus to search an IDR picture 
close to the point specified by In_time of Playltem or the 
chapter point defined by PLMark information . Consequently, 
10 the PlayList playback is executed at a higher speed. 

[0132] 

(Supplemental Notes) 

Needless to say, the foregoing descriptions do not 

15 cover all the modes of practicing the present invention. 
The present invention can be practiced also by any of the 
following modifications (A) , (B) , (C) , (D) , ... etc. It 
should be noted that the inventions recited in the claims 
of the present application are broadened or generalized 

20 descriptions of the above-described embodiments and their 
modifications. The extent of the broadening and 
generalization reflects the state of the art at the time 
of filing the present application. 
[0133] 

25 (A) According to the above embodiments, a BD-ROM is 

described as a recording medium according to the present 
invention. Yet, it should be noted that the features of 
a recording medium according to the. present invention lie 

75 



in the EP_map recorded thereon and these features do not 
depend on the physical property of the BD-ROM. Any other 
recording medium is applicable as long as the recording 
medium can store the EP_map. Specific examples of such 
5 recordingmedia include : optical discs , such as ROM, DVD-^RAM, 
DVD-RW, DVD-R, DVD+RW, DVD+R, CD-R, and CD-RW; and 
magneto-optical disks, such as PD and MO. The examples 
of the recording medium according to the present invention 
further include semiconductor memory cards, such as 

10 CompactFlash card ( registered trademark) , SmartMedia card. 
Memory Stick, MultiMediaCard, and PCM-CIA card. The 
examples also include (i) magnetic disks, such as a flexible 
disk, SuperDisk, Zip, and Clik! and (ii) a removable hard 
disk drive, such as ORB, Jaz, SparQ, SyJet, EZFley, and 

15 Microdrive. 
[0134] 

(B) Each of the above embodiments relates to the case 
where the playback apparatus decodes an AV clip stored on 
a BD-ROM and outputs the decoded AV clip to the television 

20 set. As an alternative, the playback apparatus may be 
equipped with a BD-ROM drive only and the remaining 
components are provided in the television set. In such 
a case, the playback apparatus and the television set can 
be incorporated into a home network connected with an IEEE 

25 1394 connector. In addition, although the above 
embodiments relate to the playback apparatus connected to 
the television set, the playback apparatus may instead be 
integrally provided with a display. Also, the playback 



apparatus may include only the system LSI (integrated 
circuit) that - carries out an essential part of the 
processing. - 
[0135]* 

(C) Information processing using the programs shown 
in the flowcharts is actually realized using hardware 
resources. Accordingly, the programs, which describe the 
processing steps shown in the flowcharts, are themselves 
an invention. The above embodiments all relate to the cas'e 
where the programs are incorporated in the playback 
apparatus, but the programs can be used independently of 
the playback apparatus. Acts of practicing the programs 
include (1) an act of manufacturing, (2) an act of assigning 
with or without charge, (3) an act of leasing, (4) an act 
of importing, (5) an act of providing to the public via 
a bi-directional electronic communications network, and 
(6) an" act of offering for assignment or lease using 
storefront displays, catalogs, or brochures. 

[0136] 

(D) According to the above embodiments, the digital 
stream is an AV clip in compliance with the BD-ROM standard, 
but the present invention may also be applicable to a VOB 
(Video Object) of the DVD-Video standard or the DVD-Video 
Recording standard. The VOB is a program stream that 
complies with the ISO/IEC 13818-1 Standard arid is obtained 
by multiplexing a video stream and an audio stream. Also, 
the video stream in the AV Clip may be an MPEG4 video stream 
or a WMV video stream. Further, the audio stream in the 
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AV clip may be a Linear PCM audio stream, a Dolby AC-3 audio 
stream, an MPS audio stream, an MPEG-AAC audio stream, or 
a dts audio stream. 
[0137] 

(E) According to the third embodiment, it is also 
applicable that all" the pictures specified by the In_time 
of every. Playltem in PlayList information are IDR pictures . 

Industrial Applicability 
[0138] 

The recording medium and the playback apparatus 
according to the present invention may be employed for 
personal use in a home theater system, for example. Yet, 
the present invention may be manufactured in volume in 
accordance with the internal structures disclosed in the 
above embodiments. Thus, the recording medium and the 
playback apparatus of the present invention can by 
industrially manufactured or used on an industrial scale. 
In view of the above, the recording media and the playback 
apparatus of the present invention have industrial 
applicability. 

Brief Description Of The Drawings 
[0139] 

Fig. 1 illustrates a form of using a recording medium 
according to the present inventions- 
Fig. 2 illustrates the internal structure of a BD-ROM; 
Fig. 3 schematically illustrates the structure of a 
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file with the extension ^^.m2ts"; 

Fig* 4 illustrates a process through which TS packets 
carrying an AV clip are recorded onto the BD-ROM; 

Fig. 5A illustrates a plurality of pictures arranged 
5 in the coding order; 

Fig, 5B illustrates the GOP structure of the video 
stream illustrated in Fig. 5A; 

Fig. 6A illustrates the internal structure of a 
closed-GOP in the presentation order and in the coding order; 
10 Fig. 68 illustrates the internal structure of an 

open-GOP; . 

Fig. 7A illustrates the internal structure of an IDR 
picture; 

Fig. 78 illustrates the internal structure of a Non-IDR 
15 .1 picture; 

Fig. 7C illustrates the dependencies, between the 
Non-IDR I picture and other pictures; 

Fig. 8 illustrates the dependencies that a Non-IDR 
I picture may have; 
20 Fig. 9 illustrates a process through which an IDR or 

Non-IDR I picture is converted into TS packets; 

Fig. 10 illustrates the internal structure of a piece 
of Clip information; 

Fig. IIA illustrates Stream_Coding_Inf o associated 
25 with a video stream; 

Fig. IIB illustrates Stream_Coding__Inf o associated 
with an audio stream; 

Fig. 12 illustrates the concept of entering to ah AV 



clip and exiting form the AV clip to another AV clip; 

Fig. 13 illustrates the EP_map setting associated with 
the video stream illustrated in Figs* 5A and 5B; 

Fig. 14 shows, in tabular form, pairs of EP_Low and 
5 EP_High values representing the PTS_EP_start and the 
SPN_EP_start of entry -points #1- #5 illustrated in Fig. 
13; 

Fig. 15 illustrates the range of data to be read to 
execute jump playback; 
10 Fig. 16 illustrates the data structure of PlayList 

information; 

Fig. 17 illustrates the .relationship between an AV 
clip and PlayList information; 

Fig. 18 illustrates the internal structure of a 
15 playback apparatus according to the present invention; 

Fig. 19 illustrates the internal structure o.f a decoded 
picture buffer 10; 

Fig. 20 illustrates a process of decoding a Non-IDR 
I picture by a video decoder 8; 
20 Fig. 21 illustrates the contents stored in the decoded 

picture buffer 10 at the time of the IDR picture decoding; 

Fig. 22 is a flowchart of a process of converting timing 
information into an I picture address; 

Fig. 23 is a flowchart of the PL playback performed • 
25 by a controller 44; 

Fig. 24 illustrates an application layout implementing 
a multiangle section; 

Fig. 25 illustrates the data structure of PlayList 



informations- 
Fig. 26A illustrates playback sections of a plurality 
of AV clips collectively specified by four 
Clip__Inf ormation_f ile_name fields contained in Playltem 
information; 
[0140] 

Fig. 26B illustrates extents of each AV clip on a 
PlayList timelines- 
Fig . 21 A is an allocation image showing the arrangement 
of the four AV. clips constituting the multiangle section, 
on the BD-ROM; 

Fig. 27B illustrates the internal structure of one 
extent of an AV clip; 

Fig. 28 illustrates the concept of how to determine 
the contiguous length to the extent; 

Fig. 29 illustrates the allocation of extents on the 
BD-ROM, along with the entry point setting; 

Fig. 30 illustrates valid values of PSR(3) and the 
relationship with Playltem and Clip information; 

Fig. 31 is a flowchart of processing steps performed 
to execute playback of PlayList information according to 
a second embodiment of the present invention; 

Fig. 32 is a flowchart of processing steps performed 
to read a multiangle section from a disc; 

Fig. 33 illustrates a process of reading the BD-ROM 
for executing playback of an angle image A; 

Fig. 34 illustrates a process of reading the BD-ROM 
performed upon receipt of a user operation of requesting 
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an angle change; 

Fig. 35 illustrates a process of reading the BD-ROM 
performed upon receipt of a user operation of requesting 
.an angle change; 

Fig. 36 illustrates the internal structure of PlayList 
information; 

Fig. 37 illustrates, chapters defined by PLMark 
information; 

Fig. 38 illustrates pictures of a video stream used 
by Playltem #1, together with the relevant part of entry_map 
setting; 

Fig. 39 illustrates pictures of a video stream used 
by Playltem #2; 

Fig. .40 illustrates pictures of a video stream used 
by Playltem #3; 

Fig.. 41 is a flowchart of the processing steps for 
executing a chapter search function; and 

Fig. 42 is a flowchart of the processing steps for 
executing a chapter skip function. 



Description of Reference Numerals 



[0141] 



1 



BD Drive 



2 



Arrival Time Clock Counter 



3 



Source De-packet izer 



4 



PID Filter 



5 



Transport Buffer 



6 



Multiplexed Buffer 
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7 Coded Picture Buffer 

8 Video Decoder 

10 Decoded Picture Buffer 

11 Video Plane 

5 12 Transport Buffer 

13, Coded Data Buffer 

14 ^ Stream Graphics Processor 

15 Object Buffer 

16 Composition Buffer 

10 17 Composition Controller 

18 Presentation Graphics Plane 

19 GLUT Unit 

20 Transport Buffer 

. 21 Coded Data Buffer 

15 22 Stream Graphics Processor 

23 Object Buffer 

24 Composition Buffer 

25 Composition Controller 

26 Interactive Graphics Plane 
20 27 GLUT Unit 

28 Compositor 

29 Compositor 

30 Switch 

31 Network Device 
25 32 Local Storage 

33 Arrival Time Clock Counter 

34 Source De-Packetizer 

35 PID Filter 
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46 


PSR Set 


100 


BD-ROM 


200 


Playback Apparatus 


300 


Remote Controller 


400 


Television Set 
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